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Abstract 

This paper presents a logical approach to nonmonotonic reasoning 
based on the notion of a nonmonotonic consequence relation. A condi- 
tional knowledge base, consisting of a set of conditional assertions of the 
type if . . . then . . . , represents the explicit defeasible knowledge an agent 
has about the way the world generally behaves. We look for a plausible 
definition of the set of all conditional assertions entailed by a conditional 
knowledge base. In a previous paper Jl^] , S. Kraus and the authors de- 
fined and studied preferential consequence relations. They noticed that 
not all preferential relations could be considered as reasonable inference 
procedures. This paper studies a more restricted class of consequence 
relations, rational relations. It is argued that any reasonable nonmono- 
tonic inference procedure should define a rational relation. It is shown 
that the rational relations are exactly those that may be represented by 
a ranked preferential model, or by a (non-standard) probabilistic model. 
The rational closure of a conditional knowledge base is defined and shown 
to provide an attractive answer to the question of the title. Global prop- 
erties of this closure operation are proved: it is a cumulative operation. 
It is also computationally tractable. This paper assumes the underlying 
language is propositional. 



1 Introduction 

1.1 Background 

Inference is the process of achieving explicit information that was only implicit 
in the agent's knowledge. Human beings are astoundingly good at infcring 
useful and very often reliable information from knowledge that seems mostly 
irrelevant, sometimes erroneous and even self-contradictory. They are even bet- 
ter at correcting inferences they learn to be in contradiction with reality. It is 
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already a decade now that Artificial Intelligence has realized that the analysis 
of models of such inferences was a major task. 

Many nonmonotonic systems have been proposed as formal models of this 
kind of inferences. The best known are probably: circumscription p2| , the 
modal systems of Q and Q , default logic (2^] and negation as failure . An 
up-to-date survey of the field of nonmonotonic reasoning may be found in f30f . 
Though each of these systems is interesting per se, it is not clear that any one of 
them really captures the whole generality of nonmonotonic reasoning. Recently 
(see in particular the panel discussion of |36|| ) a number of researchers expressed 
their disappointment at existing systems and suggested that no purely logical 
analysis could be satisfactory. 

This work tries to contradict this pessimistic outlook. It takes a purely 
logical approach, grounded in A. Tarski's framework of consequence relations 
|55) and studies the very general notion of a sensible conclusion. It seems that 
this is a common ground that can be widely accepted: all reasonable inference 
systems draw only sensible conclusions. On the other hand, as will be shown, the 
notion of a sensible conclusion has a non-trivial mathematical theory and many 
interesting properties are shared by all ways of drawing sensible conclusions. 

The reader is referred to Jl7| for a full description of background, motivation 
and the relationship of the present approach with previous work in Conditional 
Logic. We only wish to add here that, even though the present work will be 
compared explicitly only with previous work of E. Adams, some of the intuitions 
developed here are related with intuitions exposed already in the first works on 
Conditional Logic, such as |2^] or The interested reader may find many 
relevant articles in |L5| and should in particular look at jl4| . The main difference 
between our approach and Conditional Logic is that we take the view that the 
truth of a conditional assertion is necessary, i.e., does not depend on the state of 
the world. For us, worlds give truth values to propositions but not to assertions, 
preferential models give truth values to assertions, but not to propositions. The 
models we propose are therefore much simpler than those previously proposed 
in Conditional Logic and it is doubtful whether they can shed light on the very 
complex questions of interest to the Conditional Logic community. 

Notations and terminology conform with those of |l7|] , but the present paper 
is essentially self-contained. Preliminary versions of part of the material con- 
tained in this paper appeared in Jn| [l£| . In it was suggested that items of 
default, i.e., defeasible information should be represented as conditional asser- 
tions, i.e., pairs of formulas. For example, the information that birds normally 
fly will be represented by the conditional assertion b \^ f, where b and / are 
propositional variables representing being a bird and flying respectively. A set 
(finite or infinite) of conditional assertions is called a conditional knowledge base 
(knowledge base, in short) and represents the defeasible knowledge an agent may 
have. The fundamental question studied in this paper is the following: given 
a knowledge base K, what are the conditional assertions that should be con- 
sidered as entailed, i.e., logically implied, by K? We consider that an assertion 
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a K (3 should be entailed by K if, on the basis of the defeasible information 
contained in K and knowing that the proposition a is true, it would be sensible 
to conclude (defeasibly) that (3 is true. 

The question asked in the title and detailed just above has no simple answer 
and has probably no unique answer good for everyone in every situation. It 
may well be the case that, in different situations or for different domains of 
knowledge, the pragmatically right answers to the question of the title differ. 
This feeling has been recently expressed in [||. The first part of this paper 
defines the notion of a rational set of assertions and defends the thesis that 
any reasonable answer to the question of the title must consist of such a set of 
assertions. 

Thesis 1 The set of assertions entailed by any set of assertions is rational. 

The second part of the paper describes a specific construction, rational closure, 
and shows that the rational closure of a set of assertions is rational. This 
construction is then studied and its value as an answer to the question of the 
title assessed. We think that, in many situations, this is an acceptable answer, 
but do not claim that it provides an answer suitable to any situation. We 
have just argued that such an answer probably does not exist. One of the 
main interests of the rational closure construction is that it provides a proof of 
the existence of some uniform, well-behaved and elegant way of answering the 
question. In doing so, we develop criteria by which to judge possible answers. 
We shall in particular consider properties of the mapping from K to the set 
of all the assertions it entails and prove that our construction of the rational 
closure satisfies them. This effort and these results have to be compared with 
the essential absence, for the moment, of similar results about the systems of 
nonmonotonic reasoning mentioned above. 



1.2 Plan of this paper 

We survey here the main parts of this paper. The introductions to the different 
sections contain a detailed description. Section || is devoted to preferential 
consequence relations. This family of relations was defined and studied in ||l7f . 
The first part of this section mainly recalls definitions and results of Jl7| , its last 
part presents deep new technical results on preferential entailment that will be 
used in the sequel, but it may be skipped on a first reading. Section ^ presents 
the restricted family of relations that is of interest to us: rational relations. 
This family was first defined, but not studied, in jlT], Section 5.4]. The main 
result of this section is a representation theorem characterizing rational relations 
in terms of ranked models. Section |] shows that entailment with respect to 
ranked models is exactly entailment with respect to preferential models and 
provides an alternative proof of E. Adams' |IJ characterization of preferential 
entailment in terms of his probabilistic semantics. Appendix |b] describes a 
family of models based on non-standard (in the sense of A. Robinson) probability 
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models and shows that these models provide another exact representation for 
rational consequence relations. This provides us with a strong justification for 
considering rational relations. Section || draws on all previous sections and is 
the heart of this paper. It proposes an answer to the question of the title. 
The notion of rational closure is first defined abstractly and global properties 
proved. It is then showed that finite knowledge bases have a rational closure and 
a model-theoretic construction is provided. An efficient algorithm is proposed 
for computing the rational closure of a finite knowledge base. We then discuss 
some examples, remark that rational closure does not provide for inheritance of 
generic properties to exceptional classes, and finally propose a second thesis. 



2 Preferential relations and models 



2.1 Introduction 



The first part of this section, i.e., Sections recalls definitions and results 

of fl7| and provides an example (new) of a preferenti al re lation that cannot 
be defined by a well-founded model. Then, in Section 2A, the definition and 
some properties of preferential entailment are recalled from and some new 
remarks included. Preferential entailment is a fundamental notion that is used 
throughout the paper. The last three sections are essentially independent of 
each other. They present an in-depth study of preferential entailment. In a first 
reading, they should probably be read only cursorily. The results of Section 2.5 
expand on part of [H and are used in Section 4~2|. Section f2~6 
technique to study preferential entailment (i.c 
from Section 5 



and onwards. Section 



ranking). It 



presents a new 
is fundamental 



2.7 shows that preferential entailment 
is in the class co-NP, and hence is an co-NP-complete problem. A preliminary 
version of this last result appeared in llaj . 



2.2 Preferential relations 

Our first step must be to define a language in which to express the basic propo- 
sitions. In this paper Propositional Calculus is chosen. Let C be the set of well 
formed propositional formulas (thereafter formulas) over a set of propositional 
variables. If the set of propositional variables chosen is finite, we shall say that 
£ is logically finite. The classical propositional connectives will be denoted by 
-i, V, A, — y and «-►. The connective — > therefore denotes material implication. 
Small Greek letters will be used to denote formulas. 

A world is an assignment of truth values to the propositional variables. The 
set U is the set of all worlds. The satisfaction of a formula by a world is defined 
as usual. The notions of satisfaction of a set of formulas, validity of a formula 
and satisfiability of a set of formulas are defined as usual. We shall write |= a 
if a is valid, i.e., iff Vu G U, u \= a. 
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If a and (3 are formulas then the pair a h (3 (read "from a sensibly con- 
clude (3" ) is called a conditional assertion. A conditional assertion is a syntactic 
object to which the reader may attach any meaning he wants, but the meaning 
we attach to such an assertion, and against which the reader should check the 
logical systems to be presented in the upcoming sections, is the following: if a 
represents the information I have about the true state of the world, I will jump 
to the conclusion that j3 is true. A conditional knowledge base is any set of 
conditional assertions. Typically it is a finite set, but need not be so. Condi- 
tional knowledge bases seem to provide a terse and versatile way of specifying 
defeasible information. They correspond to the explicit information an agent 
may have. 

Certain well-behaved sets of conditional assertions will be deemed worthy of 
being called consequence relations. We shall use the notation usual for binary 
relations to describe consequence relations. So, if | — is a consequence relation, 
a h 13 indicates that the pair (a, 0) is in the consequence relation h and a \f> (3 
indicates it is not in the relation. Consequence relations correspond to the 
implicit information an intelligent agent may have. Consequence relations are 
typically infinite sets. 

Certain especially interesting properties of sets of conditional assertions (i.e., 
binary relations on C) will be described and discussed now. They are presented 
in the form of inference rules. Consequence relations are expected to satisfy 
those properties. 

(Left Logical Equivalence) (1) 

(Right Weakening) (2) 
(Reflexivity) (3) 
(And) (4) 

(Or) (5) 

(Cautious Monotonicity) (6) 



|= a f3 , a h 7 





/?h7 




* (3 , 7h a 




7^/3 






ah (3 


, ah 7 



a h (3 A 7 
ah 7 i /?h 7 



a V (3 h 7 

ah f3 , ah 7 
a A (3 h 7 



Definition 1 A set of conditional assertions that satisfies all six properties 
above is called a preferential consequence relation. 

A more leisurely introduction with motivation may be found in Jl7| where 
a larger family of consequence relations, that of cumulative relations, was also 
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studied. This family is closely related to the cumulative inference operations 
studied by D. Makinson in The attentive reader of |l7j may have noticed 
that, there, we reserved ourselves an additional degree of freedom, that we have 
denied ourselves here. There, we allowed U to be a subset of the set of all 
worlds and considered the \= symbol appearing in Left Logical Equivalence 
and in Right Weakening to be interpreted relatively to this subset. This was 
felt necessary to deal with hard constraints. In this work, we shall suppose 
that a hard constraint a is interpreted as the soft constraint, i.e., the assertion, 
-■a h false, which was recognized as equivalent to considering U to be the set 
of all worlds satisfying a in jl7], page 174]. The second proposal there, i.e., to 
consider a to be part of the facts, would not be consistent with our treatment 
of rational closure. 

For the reader's ease of mind we shall mention two important derived rules. 
Both S and Cut are satisfied by any preferential relation. 

a A /3|~ 7 



ah /3 — * 7 

a A 7 , ah 
ah 7 



(S) (7) 



(Cut) (8) 



The rule of Cut is presented here in a form that is not the most usual one. Notice, 
in particular, that we require the left-hand side of the second assumption to be 
part of the left-hand side of the first assumption. This version of Cut is close 
to the original form proposed by G. Gentzen. The following form, more usually 
used now, is not acceptable since it implies monotonicity. 

a A /3 h 7 , a'h/3 



a A a' h 7 



(9) 



2.3 Preferential models and representation theorem 

The following definitions are also taken from and justified there. We shall 
define a class of models that we call preferential since they represent a slight 
variation on those proposed in |33| . The differences are nevertheless technically 
important. 

Preferential models give a modcl-thcorctic account of the way one performs 
nonmonotonic inferences. The main idea is that the agent has, in his mind, a 
partial ordering on possible states of the world. State s is less than state t, if, in 
the agent's mind, s is preferred to or more natural than t. The agent is willing 
to conclude [3 from a, if all most natural states that satisfy a also satisfy [3. 

Some technical definitions are needed. Let U be a set and -< a strict partial 
order on U , i.e., a binary relation that is antireflexive and transitive. 

Definition 2 Let V C U . We shall say that t EV is minimal in V iff there is 
no s G V, such that s -< t. We shall say that t € V is a minimum of V iff for 
every s EV,s ^ t, we have t -< s. 
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Definition 3 Let V C U. We shall say that V is smooth iff Vf € V, either 3s 
minimal in V , such that s -< t or t is itself minimal in V . 

We may now define the family of models we are interested in. 

Definition 4 A preferential model W is a triple (S, I, -<) where S is a set, 
the elements of which will be called states, I : S ^>U assigns a world to each 
state and -< is a strict partial order on S satisfying the following smoothness 

condition: Va € L, the set of states a — {s \ s £ S, spa} is smooth, where ^ 
is defined as a (read s satisfies a) iff l(s) \= a. The model W will be said to 
be finite iff S is finite. It will be said to be well-founded iff (S, -<) is well-founded, 
i.e., iff there is no infinite descending chain of states. 

The smoothness condition is only a technical condition. It is satisfied in 
any well-founded preferential model, and, in particular, in any finite model. 
When the language C is logically finite, we could have limited ourselves to finite 
models and forgotten the smoothness condition. Nevertheless, Lemma fl| will 
show that, in the general case, for the representation result of TheorernQ to 
hold we could not have required preferential models to be well-founded. The 
requirement that the relation -< be a strict partial order has been introduced 
only because such models are nicer and the smoothness condition is easier to 
check on those models, but the soundness result is true for the larger family 
of models, where -< is just any binary relation (Definitions ^ and ||| also make 
sense for any binary relation -<). In such a case, obviously, the smoothness 
condition cannot be dropped even for finite models. The completeness result 
holds, obviously, also for the larger family, but is less interesting. 

We shall now describe the consequence relation defined by a model. 

Definition 5 Suppose a model W — (S, I, and a, G L are given. The con- 
sequence relation defined by W will be denoted by and is defined by: 
ol hif P "iff for any s minimal in a, (3. 

If a (3 we shall say that the model W satisfies the conditional assertion 
a h P, or that W is a model of a f~ (3. 

The following theorem characterizes preferential consequence relations. 

Theorem 1 (Kraus, Lehmann and Magidor) A binary relation \^ on C 
is a preferential consequence relation iff it is the consequence relation defined 
by some preferential model. If the language C is logically finite, then every 
preferential consequence relation is defined by some finite preferential model. 

The next result shows we could not have restricted ourselves to well-founded 
models. 

Lemma 1 There is a preferential relation that is defined by no well-founded 
preferential model. 
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Proof : Let C be the prepositional calculus on the variables pi , i E uj (uj is the set 

of natural numbers). We shall consider the model W = (V, I, -<) where V is the 
set {si | i E u> U {oo}}, Si -< Sj iff i > j (i.e., there is an infinite descending chain 
of states with a bottom element) and l{si)(pj) is true iff j > i, for i E uj U {00} 
and j £ uj. The smoothness property is satisfied since the only subsets of V 
that do not have a minimum arc infinite sets A that do not contain Soo and any 
a E L that is satisfied in all states of such a set A is also satisfied in . The 
model W defines a preferential relation |~w such that Vi E uj , Pi+i an d 

Pi+i f~w "'Pii but po \/^ w false. But clearly, any preferential model defining 
such a relation must contain an infinite descending chain of states. | 

We do not know of any direct characterization of those relations that may be 
defined by well-founded preferential models. But Lemma |^ will show that many 
relations may be defined by well-founded preferential models. It is clear, though, 
that the canonical preferential model provided by the proof of Theorem [l] is 
rarely well-founded. Consider, for example, the preferential closure of the empty 
knowledge base on a logically infinite language L. It may be defined by some 
well-founded preferential model (the order -< is empty) . But its canonical model 
is not well-founded (consider states whose second components are larger and 
larger disjunctions). We may only make the following obvious remark: if the 
underlying language C is logically finite, then all canonical models are well- 
founded. 



2.4 Preferential entailment 

Now that we have a proof-theoretic definition of a class of relations, a class of 
models and a representation theorem relating them, it is natural to put down 
the following definition. It will serve us as a first approximate answer to the 
question of the title. 

Definition 6 The assertion A is preferentially entailed by K iff it is satisfied 
by all preferential models o/K. The set of all conditional assertions that are 
preferentially entailed by K will be denoted by K p . The preferential consequence 
relation K p is called the preferential closure o/K. 

In [l^l it was noted that the characterization of preferential consequence rela- 
tions obtained in Theorem |l| enables us to prove the following. 

Theorem 2 Let K le a set of conditional assertions, and A a conditional as- 
sertion. The following conditions are equivalent: 

1. A is preferentially entailed by K, i.e.. A E K p 

2. A has a proof from K in the system P consisting of the Rules [J to |^. 
The following compactness result follows. 
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Corollary 1 (compactness) K preferentially entails A iff a finite subset of 
K does. 

The following also follows from Theorem ^. 

Corollary 2 The set K p , considered as a consequence relation, is a preferential 
consequence relation, therefore there is a preferential model that satisfies exactly 
the assertions of K p . If K is itself a preferential consequence relation then 
K = K p . The set K p grows monotonically with K. 

We see that the operation K i— ► K p is a compact monotonic consequence opera- 
tion in the sense of Tarski |}5| . We have a particular interest in finite knowledge 
bases. It is therefore useful to put down the following definition. 

Definition 7 A preferential consequence relation is finitely generated iff it is 
the preferential closure of a finite knowledge base. 

Lemma || will show that finitely generated relations have interesting properties. 
In fTljl , it was shown that any preferential relation defines a strict ordering on 
formulas by: a < [3 iff aV(3 f~ a and a V/3 \ft (3. 

Definition 8 A preferential relation is well-founded iff the strict ordering re- 
lation < it defines is well-founded. 

The following is easy to show. 

Lemma 2 A preferential relation is well-founded iff the canonical model built 
in the proof of Theorem ^ is well-founded. 



We noticed, at the end of Section 2.3, that not all preferential relations that 



may be defined by well-founded preferential models are well-founded. 

Lemma 3 Any finitely generated preferential relation is defined by some well- 
founded preferential model. 

Proof: Let K be any finite set of assertions. Let L t ,i £ w be an infinite se- 
quence of larger and larger logically finite sublanguages of L such that every Li 
contains all the formulas appearing in the assertions of K and such that L is 
the union of the Lj's. By Theorem [IJ for each i there is a finite preferential 
model W[ that defines the preferential closure of K over Let Wi be the 
finite preferential model (over L) obtained by extending the labeling function 
of W[ to the variables of L — Li in some arbitrary way. Clearly Wi is a prefer- 
ential model of K. Let W be the structure obtained by putting all the WiS one 
alongside the other (the partial ordering -< on W never relates states belonging 
to W^s with different i's). The structure W is well-founded, therefore satisfies 
the smoothness condition and is a preferential model. Any assertion that is 
preferentially entailed by K (over L) is satisfied by every Wi, and is therefore 
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satisfied by W. For any assertion A that is not preferentially entailed by K one 
may find a language Li large enough to include the formulas of A. Over Li, the 
assertion A is not preferentially entailed by K, by Theorem 0, since a proof in 
the small language is a proof in the larger one. Therefore W[ does not satisfy 
A. We conclude that Wi does not satisfy A and that W does not satisfy A. I 



2.5 Some properties of preferential entailment 

The following result, Theorem [| is new. It is important for several reasons. 
It uses the semantic representation of Theorem [l] and a direct proof us ing only 



proof-theoretic arguments seems difficult. It will be used in Section 4.2. Its 
Corollary [| should provide a starting point for the application to preferential 
entailment of methods based on or related to resolution. First a definition. 

Definition 9 If a formula a is such that a \/> false, we shall say that a is 
consistent (for the consequence relation |~ ). A formula is consistent for a 
model iff it is consistent for the consequence relation defined by the model, or 
equivalently iff there is a state in the model that satisfies a. 

We shall now define a basic operation on preferential models. Suppose M is a 
preferential model (V, I, -<). For s, t G V we shall write s ^ t iff s ~< t or s = t. 
Let a be a formula and u € V be a minimal element of a. Let be the strict 
partial order obtained from -< by making u a minimum of a, i.e., s t iff s -< t 
or s u and there exists a state w G a such that w -<t. The following lemma 
describes the properties of the construction described above. 

Lemma 4 The structure M% = (V, I, ^} is a preferential model. The conse- 
quence relation defined by extends the consequence relation defined by M . 
In this model u is a minimum of a. Both models have the same set of consistent 
formulas. 

Proof: It is easy to see that -<™ is irreflexive and transitive. It is also easy to 
see that, under u is a minimum of a. We want to show now that, for any 
/3 6 L, the set (3 is smooth, under -<^. Let s E (3. Since is smooth under -<, 
there is a state t, minimal under -< in (3 such that t < s. If t is still minimal 
in (3 under -<^, then we are done. If not, there is some state v £ (3 such that 
v <u and v ^ s. Since (3 is smooth under there is a state w, minimal in 
(3 under -< such that w -< v. Since w -< u, w must be minimal in (3 also under 
But w s. We have shown that (3 is smooth under ^JJ. To see that 
the consequence relation defined by extends the one defined by M, just 
notice that, since ^ extends -<, all minimal elements under the former arc also 
minimal under the latter. Lastly, since M and M™ have exactly the same set 
of worlds and the same labeling function, they define exactly the same set of 
consistent formulas. | 



10 



Theorem 3 Let K be a knowledge base and ah ft an assertion that is not pref- 
erentially entailed by K. The formulas that are inconsistent for the preferential 
closure of KUjaK ~^ft} are those that are inconsistent for the preferential 
closure of K. 

Proof: Suppose that ah ft is not preferentially entailed by K. Then, let 
W = (5, Z, -<) be the preferential model the existence of which is guaranteed by 
Theorem [j]and that defines K p . The model W does not satisfy ah ft. There is 
therefore a minimal element s G S of a that does not satisfy ft. Consider now 

the model W' = f . By Lemma ^ this is a preferential model that satisfies 
all the assertions satisfied by W, therefore it satisfies all the assertions of K. 
Since s is the only minimal element of a, it satisfies KU{ah "'ft}- Suppose 7 
is inconsistent for (K U {ah _, /?}) p - Then it must be inconsistent for W'. By 
Lemma ^ it is inconsistent for W, therefore inconsistent for K p . | 

Corollary 3 Let K be a conditional knowledge base and a h ft a conditional 
assertion. The assertion ah ft is preferentially entailed by K iff the assertion 
a h false is preferentially entailed &i/KU{aK ~*ft}- 

Proof : The only if part follows immediately from the soundness of the And 
rule. The if part, follows immediately from Theorem^. | 

2.6 The rank of a formula 

In this section, we introduce a powerful tool for studying preferential entailment. 
Given a knowledge base, we shall attach an ordinal, its rank, to every formula. 
We shall prove an important result concerning those ranks, and, in particular, 
show that a knowledge base K and its preferential closure K p define the same 
ranks. 

Definition 10 Let~K. be a conditional knowledge base (i.e., a set of conditional 
assertions) and a a formula. The formula a is said to be exceptional for K 
iff K preferentially entails the assertion true h ~^ct- The conditional assertion 

Ji= a h ft is said to be exceptional for K iff its antecedent a is exceptional for 
K. 

The set of all assertions of K that are exceptional for K will be denoted by 
E(K). Notice that E(K) C K. If all assertions of K are exceptional for K, 
i.e., if K is equal to E(K), we shall say that K is completely exceptional. The 
empty knowledge base is completely exceptional. Notice that, in the definition 
above, K may be replaced by its preferential closure K p . 

Given a conditional knowledge base K (not necessarily finite), we shall now 
define by ordinal induction an infinite non-increasing sequence of subsets of K. 
Let Cq be equal to K. For any successor ordinal r + 1, C r+ i will be E(C T ) and 
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for any limit ordinal r, C r is the intersection of all C p for p < r. It is clear 
that, after some point on, all C's are equal and completely exceptional (they 
may be empty, but need not be so). We shall say that a formula a has rank 
r (for K) iff r is the least ordinal for which a is not exceptional for C T . A 
formula that is exceptional for all C T 's is said to have no rank. Notice that 
such a formula is exceptional for a totally exceptional knowledge base. The 
following is a fundamental lemma on preferential entailment. It says that, as 
far as preferential entailment is concerned, non-exceptional assertions cannot 
help deriving exceptional assertions. The notion of rank defined above proves 
to be a powerful tool for studying preferential entailment. 

Lemma 5 Let t be an ordinal. Let K be a conditional knowledge base and A 
a conditional assertion whose antecedent has rank larger or equal to r (or has 
no rank). Then A is preferentially entailed by C'o iff it is preferentially entailed 
byC T . 

Proof: The i/part follows from the fact that C T is a subset of Co- The only 
if part is proved by induction on the length of the proof of A from Co- If 
the proof has length one, i.e., A is obtained by Reflexivity or is an assertion 
of Co, then the result is obvious. If the last step of the proof is obtained 
by Right Weakening or And, the result follows from a trivial use of the 
induction hypothesis. If the last step of the proof is obtained by Left Logical 
Equivalence, the result follows from the induction hypothesis and the fact 
that, if a and a' are logically equivalent then a and a' have the same rank. If 
the last step is a use of Or, and A is of the form a V (3 [~ 7 then just remark 
that the rank of the disjunction a V (3 is the smaller of the ranks of a and [3. 
Both a and (3 have therefore a rank larger or equal to r and one concludes by the 
induction hypothesis. If the last step is a use of Cautious Monotonicity, and 
A is of the form a A [3 |~ 7, where a |~ (3 and ah 7 are preferentially entailed 
(with short proofs) by Co, let a be the rank of a. By the induction hypothesis 
Cfj preferentially entails (3. Since a is not exceptional for C CT , we conclude 
that a A (3 is not exceptional for C CT , and therefore has rank a. But a A (3 has 
rank larger or equal to r. Therefore r < a. The formula a has rank larger or 
equal to r and we may apply the induction hypothesis to conclude that both 
a K (3 and aK 7 are preferentially entailed by C p . | 

Lemma 6 Let K and K' be knowledge bases such that K C K' C K p . For any 

formula, the rank it is given by K' is equal to the rank it is given by K. 

Proof: Using Lemma |[ one shows by ordinal induction that C T C C' T C (C r ) p . 
I 



The following definition will be useful in Section 5.6 



Definition 11 A knowledge base K is said to be admissible iff all formulas that 
have no rank for K are inconsistent for K. 
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We shall immediately show that many knowledge bases are admissible. 

Lemma 7 If the preferential closure of K is defined by some well-founded pref- 
erential model, then K is admissible. In particular, any finite knowledge base is 
admissible. 

Proof: We have noticed, in Lemma || that ranks are stable under the the 
replacement of a knowledge base by its preferential closure. Let P be the pref- 
erential closure of K. Suppose P is defined by some well-founded preferential 
model W . Suppose a has no rank. We must show that no state of W satisfies a. 
As noticed above, there is an ordinal r such that C T is completely exceptional 
and a is exceptional for C T . We shall show that no state of W satisfies a formula 
that is exceptional for C T . Indeed, if there were such a state, there would be 
such a minimal state, s, since W is well-founded. But W is a model of C T and 
no state below s satisfy any antecedent of C T , since C T is totally exceptional. 
Therefore the preferential model consisting of s alone is a model of C T . But, in 
a model of C T , no minimal state satisfy a formula that is exceptional for C T . A 
contradiction. It follows now from Lemma |^ that any finite knowledge base is 
admissible. | 



2.7 Computing preferential entailment 

This section is devoted to the study of the computational complexity of prefer- 



ential entailment. It is not needed in the sequel. We shall explain in Section 3.5 
why preferential entailment is not the right notion of entailment to answer the 
question of the title, nevertheless preferential entailment is a central concept and 
it is therefore worthwhile studying its computational complexity. The results 
here are quite encouraging: the problem is in co-NP, i.e., in the same polynomial 
class as the problem of deciding whether a propositional formula is valid. 

Lemma 8 Let K be a finite conditional knowledge base and a |~ [3 a conditional 
assertion that is not preferentially entailed by K. There is a finite totally (i.e., 
linearly) ordered preferential model o/K no state of which satisfies a except the 
top state. This top state satisfies a and does not satisfy (3. 

Proof: Let £ C C be a logically finite language, large enough to contain a, 
(3 and all the assertions of K. Let us now consider £' to be our language of 
reference. Clearly, a f~ (3 is not preferentially entailed by K, since a proof over 
the smaller language is a proof over the larger language. By Theorem [j], there is 
a finite preferential model W (over £') of K that does not satisfy ah (3. In W, 
there is therefore a state s, minimal in a, that satisfies a but does not satisfy 
[3. Consider the submodel W obtained by deleting all states of W that are not 
below or equal to s. It is clearly a finite preferential model of K, with a top 
state that satisfies a but not (3. Let V be obtained by imposing on the states 
of W any total ordering that respects the partial ordering of W . Since there 
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are only finitely many states in V, the smoothness condition is verified and V 
is a preferential model (on £'). It is a model of K but not of A. Now we may 
extend the labeling function of V to the propositional variables of C that are 
not in C any way we want, to get the model requested. Notice that the model 
obtained satisfies the smoothness condition because it is finite. | 

Theorem 4 There is a non- deterministic algorithm that, given a finite set K 
of conditional assertions and a conditional assertion A, checks that A is not 
preferentially entailed by K. The running time of this algorithm is polynomial 
in the size o/K (sum of the sizes of its elements) and A. 

Proof: Let K be {7^ |~ Si}^-.. Let fC{l,,,., N} be a set of indices. We 

shall define: ipi & = \J ieI 7i and ipi == f Aiei ("ft ~~ * A sequence is a sequence 
of pairs (Jj, fi) for i = 0, . . . , n, where Ii C / and /j is a world. Let a and (3 be 
in £. 

Definition 12 ^4 sequence i = 0, ...,n, is a witness for a |~ /3 (we 

mean a witness that a \^ (3 is not preferentially entailed by K J zjjf 

^ AM/*. Vfc = 0,...,n 

5. M=¥J 7fc , V* = 0,...,n-1 

5. 4+i = 4 HO* I fk ¥= Vfc = 0,...,n-1 

^. 7o = {l,...,iV} 

5. /fcfta, Vfc = 0, . . . , n - 1 

6. /„h«A ->P. 

We must check that: witnesses are short and a conditional assertion has a 
witness iff it is not preferentially entailed by K. For the first point, just remark 
that, for k = 0, . . . , n — 1 the inclusion Ik D Ik+i is strict because of items [| 
and ||. The length of the sequence is therefore bounded by the number of 
assertions in K. But, each pair has a short description. For the second point, 
suppose first there is a witness for a f~ /3. Then the ranked model W consisting 
of worlds /o, . . . , f n where fk -< fk+i for fc = 0, . . . , n — 1 satisfies K but not 
a Y~> (i. That it does not satisfy a |~ f3 is clear from items |5| and [| Let us 
check that W satisfies 7$ |~ <$j. If none of the /fc's, fc = 0, . . . , n satisfies 7$ then 
satisfies 74 |~ 77 for any rj in £. Suppose therefore that j is the smallest k for 
which /j (= 7j. We must show that fj \= 5j. But, by items and [| i G /j and 
by itemg, /j |= ^. 

Suppose now that a |~ /3 is not preferentially entailed by some given finite 
K. By Lemma |[ there is a finite linearly ordered model W of K, no state of 
which satisfies a, except the top state that is labeled by a world m that satisfies 
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a A -i/3. Let I a = {1, . . . , TV}. It is easy to see that (remark 1): if is any 
preferential model of K, for any set / C I Q , V satisfies ipj |~ ^j. Let us now 
consider first the set a V tpi . It cannot be empty, therefore it has a unique 
minimal state. Let fo be the label of this state. We must consider two cases. 
First suppose that fo \= a. Then fo is minimal in a and therefore must be m. 
In such a case (Io,m) is a witness. The only thing to check is that item |l| is 
satisfied. Indeed either m (= ipi and we conclude by remark 1 or y% = and m 
satisfies none of the ji's. Let us deal now with the case fo y= a. We shall build 
a sequence beginning by (lo, m). Since m does not satisfy a, it must satisfy ipi , 
which takes care of item |[ Remark 1 takes care of item [|. Let us now define 
h = lo f]{j | fo V= i s strictly smaller than Io- We may now consider the 

set a V <pi 1 . It is not empty and therefore has a unique minimal clement and 
we may, in this way, go on and build a proof for a |~ /3. | 

Since it is clear that preferential non-entailmcnt is at least as hard as sat- 
isfiability (consider assertions with antecedent true), we conclude that it is an 
NP-complete problem, i.e., that preferential entailment is co-NP-complete. A 



remark of J. Dix that will be explained at the end of Section 5.8 shows that pref- 



erential entailment is reducible to the computation of rational closure and that 
this reduction, when applied to Horn formulas, requires only the consideration 
of Horn formulas. It follows that, if we restrict ourselves to Horn assertions, 
computing preferential entailment has only polynomial complexity. 



3 Rationality 



3.1 Introduction 

In this section we explain why not all preferential relations represent reasonable 
nonmonotonic inference procedures. We present some additional principles of 
nonmonotonic reasoning and discuss them. Those principles are structurally 
different from the rules of preferential reasoning, since they are not of the type: 
deduce some assertion from some other assertions. Sections 3.2 and 3.3 present 
weak principles. Some results are proven concerning those principles. Deeper 
results on those principles, found after a first version of this paper had been cir- 
culated, appear in pTlJ . Our central principle is presented in Section 3.4. Those 
principles were first described in [n7| but the technical results presented here are 



new. In 3J3, the value of preferential entailment as an answer to the question of 
the title is discussed. Our conclusion is that it is not a satisfacto ry a nswer, since 
it does not provide us with a rational relation. Then, in Section 3J3, a restricted 
family of preferential models, the family of ranked models, is presented and a 
representation theorem is proved. The result is central to this paper but the 
proof of the representation theorem may be skipped on a first reading. The 
representation theorem appeared in fl9|| . The family of ranked models is closely 
related to, but different from, a family studied in |Q and Section 3.7 explains 
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the differences. 



3.2 Negation Rationality 

In [[l7| Section 5.4], it was argued that not all preferential consequence relations 
represented reasonable inference operations. Three rationality properties were 
discussed there, and it was argued that all three were desirable. Those properties 
do not lend themselves to be presented as Horn rules (deduce the presence of an 
assertion in a relation from the presence of other assertions) but have the form: 
deduce the absence of an assertion from the absence of other assertions. All of 
them are implied by Monotonicity. The reader may find the discussion of jl7| 
useful. Here technical results will be described. The first property considered 
is the following. 

aAjft [3 , a A ft [3 



aft [3 



(Negation Rationality) (10) 



Lemma 9 There is a preferential relation that does not satisfy Negation Ra- 
tionality. 

Proof: Take a preferential model containing four states: Si,i = 0, . . .3, with 
so ~< Si and S2 -< S3. Let the even states be the only states satisfying q and so 
and S3 be the only states satisfying p. One easily verifies that the consequence 
relation defined by this model is such that true |~ q, but p ft q and -\p ft q. 
I 

No semantic characterization of relations satisfying Negation Rationality 
is known. It has been shown in (lTj that the consequence relation defined by 
Circumscription does not always satisfy Negation Rationality. 

3.3 Disjunctive Rationality 

The next property is the following. 

a ft 7 . P ft 7 



We may prove the following. 



(Disjunctive Rationality) (11) 



Lemma 10 Any preferential relation that satisfies Disjunctive Rationality 
satisfies Negation Rationality. 

Proof: Suppose a A 7 ft (3 and a A -17 ft 0. By Disjunctive Rationality, 
we conclude that a A 7 V a A ^7 ft P- We conclude by Left Logical Equiva- 
lence. I 

Lemma 11 There is a preferential relation that satisfies Negation Rational- 
ity but does not satisfy Disjunctive Rationality. 



1G 



Proof: Let us consider the following preferential model W. The model W has 
four states: ao,oi,&0)&l< The ordering is: ao -< a\ and &o -< &i< The language 
has three propositional variables: p, q and r. The two states ai and b\ (the top 
states) are labeled with the same world that satisfies only p and q. State ao 
is labeled with the world that satisfies only p and r and the state 60 with the 
world that satisfies only q and r. The preferential relation defined by W does 
not satisfy Disjunctive Rationality but satisfies Weak Rationality. For the 
first claim, notice that: p V q T but p \/^ w r and q \ft w r. For the second 
claim, suppose a 7, but a A j3 \fi w 7. Then it must be the case that there 
is a minimal state of a that does not satisfy (3 and, above it, a state that is 
minimal in a A (3. This last state must be labeled by a world that is the label 
of no minimal state of a. Therefore, a must contain all four states of W, and 
a A j3 must contain either the two top states alone or the two top states and 
one of the bottom states. In each case it is easy to see that a A -i/3 7 since 
the minimal states of a A -<j3 are all also minimal in a. | 

No semantic characterization of relations satisfying Disjunctive Rational- 
ity was known at the time this paper was elaborated. M. Freund has now 
provided a very elegant such characterization together with an alternative proof 
of our Theorem pi; the canonical model he builds is essentially the same as ours. 



3.4 Rational Monotonicity 

The last property is the following. 

aA/3^7 , a\/> ->{} 
a \ft 7 



(Rational Monotonicity) (12) 



This rule is similar to the thesis CV of conditional logic (see pq]). The reader 
is referred to |l^, Section 5.4] for a discussion of our claim that reasonable con- 
sequence relations should satisfy Rational Monotonicity. Some researchers 
in Conditional Logic (J. Pollock in particular) have objected to CV as a valid 
thesis for (mainly subjunctive) conditionals. Echoes of this debate may be found 
in jl^, end of Section 4.4]. The objections to CV that hold in the conditional 
logic framework do not hold for us, though their consideration is recommended 
to the reader. The most attractive feature of Rational Monotonicity is prob- 
ably that it says that an agent should not have to retract any previous defeasible 
conclusion when learning about a new fact the negation of which was not previ- 
ously derivable. In | j32| , K. Satoh aptly decided to call nonmonotonic reasoning 
that validates Rational Monotonicity lazy. The rule of Rational Mono- 
tonicity should be distinguished from the following rule, which is satisfied by 
any preferential relation. 

a A 13 h -.7 , a \f ^(3 
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Definition 13 A rational consequence relation is a preferential relation that 
satisfies Rational Monotonicity. 

Two different representation theorems will be proved about rational relations, 



in Sections 3.6 and in Appendix |B|. The last one seems to provide evidence that 
reasonable inference procedures validate Rational Monotonicity and that all 
rational relations represent reasonable inference procedures. 

Lemma 12 A rational relation satisfies Disjunctive Rationality. 

Proof: Suppose a \/> 7 and (3 \f> 7. By Left Logical Equivalence we have 
(a V (3) A a \f> 7. If we have a V (3 \f> ->a, then we could conclude by Rational 
Monotonicity that a V (3 ^7. Suppose then that a V (3 K ^ct. If we had 
a\/ (3 h 7, we would conclude by preferential reasoning that (3 \/> 7. I 

Lemma 13 (David Makinson) There is a preferential relation satisfying Dis- 
junctive Rationality that is not rational. 

Proof : We shall build a preferential model that defines a consequence relation 
satisfying Disjunctive Rationality but not Rational Monotonicity. Let C 

be the prepositional calculus on the three variables: po, Pi, Pi- Let U contain 
all prepositional worlds on those variables. Let S contain three elements: s,; for 
i = 0,1,2 and l(si) satisfy only pi. The partial order -< is such that s\ -< S2 
and no other pair satisfies the relation. This defines a preferential model W . 
First we shall show that the consequence relation defined by W does not satisfy 
Rational Monotonicity. Indeed, we have both po V p\ V P2 Y^w ~^Vi an d 
Po Vpi V p 2 \f w Pi- Nevertheless, we also have -tpi A (p Vpi Vp 2 ) V>w ^Vi- 
Let us show now that any preferential model that does not satisfy Disjunctive 
Rationality must have at least 4 states. Suppose a V (3 K 7, but a \f 7 and 
/3 \f> 7. The last two assumptions imply the existence of states a and &, minimal 
in a and [3 respectively and that do not satisfy 7, and therefore are not minimal 
in a V [3. Those states are different, since any state minimal in both a and (3 
would be minimal in a V (3. By the smoothness condition there must be a state 
a' minimal in a V (3 and such that a' -< a. Clearly a' satisfies 7 and does not 
satisfy a (since a is minimal in a) but satisfies (3. Similarly there must be a 
state b' minimal in a V (3 and such that b' -< b and b' satisfies 7 and does not 
satisfy (3, but satisfies a. It is left to show that all four states are different. We 
have already noticed that a ^ b. The states a' and b 1 satisfy 7 and are therefore 
different from a and b. But b' satisfies a and a' does not and therefore a' b' . 
I 

3.5 Discussion of Preferential Entailment 

We may now assess preferential entailment as a possible answer to the question 
of the title. Corollary ^| explains why the notion of preferential entailment 
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cannot be the one we are looking for: the relation K p can be any preferential 
relation and is not in general rational. For typical K's, K p fails to satisfy a 
large number of instances of Rational Monotonicity and is therefore highly 
unsuitable. One particularly annoying instance of this is the following. Suppose 
a conditional knowledge base K contains one single assertion p f~ q where p 
and q are different propositional variables. Let r be a propositional variable, 
different from p and q. We intuitively expect the assertion p Ar |~ q to follow 
from K. The rationale for that has been discussed extensively in the literature 
and boils down to this: since we have no information whatsoever about the 
influence of r on objects satisfying p it is sensible to assume that it has no 
influence and that there are normal p-objects that satisfy r. The normal p A r- 
objects are therefore normal p-objects and have all the properties enjoyed by 
normal p-objects. Nevertheless it is easy to check that p Ar |~ q is not in K p . 
The problem lies, at least in part, with the fact that K p is not rational, since any 
rational relation containing p |~ q , must contain p Ar q unless it contains 
p \^ -ir. 

In conclusion, it seems that the set of conditional assertions entailed by 
K should be larger and more monotonic than the set K p . It should also be 
rational. This question will be brought up again in Section |^ and a solution will 
be proposed. 

3.6 Ranked models and a representation theorem for ra- 
tional relations 

In this section a family of preferential models will be defined and it will be 
shown that the relations defined by models of this family are exactly the rational 
relations. 

Lemma 14 // -t, is a partial order on a set V , the following conditions are 
equivalent. 

1. for any x,y,z^V if x -f. y, y/i and z -< x, then z -< y 

2. for any x,y,z<EVifx~<y 7 then, either z -< y or x -< z 

3. for any x,y,zGV if x -f. y and y -f z, then i/z 

4-. there is a totally ordered set £1 (the strict order on will be denoted by 
<) and a function r : V i— > fl (the ranking function) such that s -<t iff 
r(s) < r(t). 

The proof is simple and will not be given. A partial order satisfying any of the 
conditions of Lemma |l4| will be called modular (this terminology is proposed 
in Jl^] as an extension of the notion of modular lattice of (l|). 

Definition 14 A ranked model W is a preferential model (V, I, ^} for which the 
strict partial order -< is modular. 
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Those models are called ranked since the effect of function r of property [| of 
Lemma |l4| is to rank the states: a state of smaller rank being more normal than 
a state of higher rank. We shall always suppose that a ranked model W comes 
equipped with a totally ordered set Q and a ranking function r. Notice that 
we still require W to satisfy the smoothness condition. It is easy to see that 
for any subset T of V and any t 6 T, t is minimal in T iff r(t) is the minimum 
of the set r(T). It follows that all minimal elements of T have the same image 
by r. The smoothness condition is then equivalent to the following: for any 
formula a G L, if a is not empty, the set r(a) has a minimum. The smoothness 
condition is always verified if SI is a well-ordered set. The reader may check that 
the preferential model W defined in the proof of Lemma [l] is ranked (it is even 
totally ordered) . It follows that there are rational relations that are defined by 
no well-founded ranked model. The following is a soundness result. 

Lemma 15 If W is a ranked model, the consequence relation it defines is 
rational. 

Proof: It is enough to show that satisfies Rational Monotonicity. 

For this, the smoothness condition is not needed; it is needed, though, for 
the soundness of Cautious Monotonicity. Suppose W is a ranked model. 
We shall use the notations of Definition |l4|. Suppose also that a 7 and 
a \fi w -i )3. From this last assumption we conclude that there is a minimal 
element of a that satisfies j3. Let t e V be such a state. Let s € V be a minimal 
element of a A f3. Since t£a/\{3,t-^s and r(s) < r(t). But this implies that s 
is minimal in a: any state u such that u -< s satisfies r(u) < r(s) and therefore 
r(u) < r(t) and u -<t. Since a 7, s ^ 7- I 

We shall show now that the converse of Lemma |l5| holds. We shall first 
mention four derived rules of preferential logic. In fact the first three of these 
rules are even valid in cumulative logic (see |l7], Section 3] ) . Their proof (either 
proof-theoretic or model-theoretic) is straightforward and is omitted. 



Lemma 16 The following rules are derived rules of preferential logic: 

a ]y false 

a A (3 |~ false 

a V (3 h -./? 

aV/3V7h"'aA^/3 
P V 7 h -./? 

a V P V 7 |~ -iq 
We shall now derive a property of rational relations. 



(14) 
(15) 
(16) 
(17) 
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Lemma 17 If |~ is a rational relation, then the following rule is valid: 

Proof: From the first hypothesis, by Rule [l?] one deduces a V (3 V 7 |~ -<a. 
From the second hypothesis, by Rule |l6| one deduces a V (3 V 7 ^ ->(a V /3). If 
one applies now Rational Monotonicity, one gets the desired conclusion. | 

For the completeness result, we proceed in the style of L. Henkin. Complete- 
ness proofs in this style have been used in conditional logics since 
number of technical lemmas are needed, we have relegated them to Appendix |A| 
and state here the characterization theorem. 

Theorem 5 A binary relation f~ on C is a rational consequence relation iff it 
is the consequence relation defined by some ranked model. If the language C is 
logically finite, then every rational consequence relation is defined by some finite 
ranked model. 

Proof: The z/part is Lemma For the only z/part, let K be a consequence 
relation satisfying the rules of R. The relation |~ defines a structure W as de- 
scribed in Appendix [a|. By Lemmas |d] and [36], W is a ranked model. We claim 
that, for any a, (3 G L, a |~ (3 iff a (3- Suppose first a [~ j3. By Lemma |l2|, 
if < to, (3 > is minimal in a, then m is normal for a. We conclude that m\= [3 
and < m, (3 > ^ (3. Therefore a (3- Suppose now that a (3- Let m be 
a normal world for a. By Corollary]^, the pair < to, a > is minimal in a and 
therefore m \= f3. All normal worlds for a therefore satisfy f3 and Lemma 8 of 
[ p"7[ implies that a K (3. For the last sentence of the theorem, notice that, if 
the language £ is logically finite, the model W is finite. | 

As we remarked just prior to Lemma [l^, the theorem would not hold had 
we required models to be well-founded. 



34 . Since a 



3.7 Comparison with Delgrande's work 

The system of proof-rules and the models presented above may be compared 
with the results of J. Delgrande in |J. The general thrust is very similar 
but differences are worth noticing. A first difference is in the language used. 
Delgrande's language differs from this paper's in three respects: his work is 
specifically tailored to first-order predicate calculus, whereas this work deals 
with propositional calculus; he allows negation and disjunction of conditional 
assertions, which are not allowed in this paper; he allows nesting of conditional 
operators in the language, though his completeness result is formulated only 
for unnested formulas. Therefore Delgrande's central completeness result in 
, only shows that any proposition in which there is no nesting of conditional 
operators (let us call those propositions flat) that is valid has a proof from the 
axioms and rules of his system. But this proof may use propositions that are 
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not flat. The completeness results reported here show that valid assertions have 
proofs that contain only flat assertions. 

A second difference is that Delgrande's logical system is different from ours: 
Delgrande's logic N does not contain Cautious Monotonicity. Our class of 
ranked models is more restricted than his class of models: our models are re- 
quired to obey the smoothness condition and Delgrande's are not. One may 
also notice that our logic enjoys the finite model property, but Delgrande's does 
not. This difference between our two logical systems may sound insignificant 
when one remarks that many instances of the rule of Cautious Monotonic- 
ity may be derived from Rational Monotonicity, and are therefore valid 
in Delgrande's system N. What we mean is that if a [~ /3 and a |~ 7 then, 
if a \f> -ifj one may conclude a A j3 h> 7 by Rational Monotonicity rather 
than by Cautious Monotonicity. But if a |~ -i/3, and therefore a |~ false 
one cannot conclude. The Rule |l4] is sound in preferential logic but not in 
Delgrande's logic. A proof will soon be given. We want to remark here that 
Rule ( fl4| ) is very natural, since the meaning of a h false is that if a is true 
than anything may be true, ft therefore means that it is absolutely unthinkable 
that a be true. In such a case we would expect a A (3 to be also absolutely 
unthinkable. 

Let us show now that Rule ([l4]) is not valid for Delgrande's structures. Con- 
sider the following structure. Let the set V consists of one infinite descending 
chain: -< is a total ordering. Suppose now that the top element of V is the only 
state that satisfies the prepositional variable p. In this structure true is V and 
has no minimal element, therefore true \^ false. But p consists only of the top 
element and has a minimal point and therefore p \/> false. We have shown that 
the Rule |l4| is not valid for Delgrande's structures. This example also shows 
that Delgrande's logic does not posses the finite model property. 

A third difference is that his definition of the set of conditional assertions 
entailed by a conditional knowledge base is different from the one presented 
here, at least at first sight. 



4 Ranked entailment 
4.1 Introduction 

After having defined the family of relations and the family of models we are 
interested in, we proceed to study the notion of entailment provided by those 



models. Our main result is presented in |4.2| . It is negative, in the sense that this 



entailment is equivalent to preferential entailment. A preliminary version of this 
result may be found in |l9]. The collapsing of the two notions of entailment, 
as opposed to the two different classes of relations represented, sheds a new 
light on the results of |J. Section 13 describes the probabilistic semantics 



given to preferential entailment by E. Adams in Q and shows how the result of 
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Section 4.2 provides an alternative proof for Adams' results. The results of this 



section were contained in Q . 

4.2 Ranked entailment is preferential entailment 



In the discussion of Section 3.5, we expressed the wish that the set of assertions 
entailed by a conditional knowledge base K be rational and larger than K p . 
A natural candidate would be the set of all assertions that are satisfied in all 
ranked models that satisfy the assertions of K. This is an intersection of rational 
relations. This proposal fails in a spectacular way. Problems with this proposal 
have been noted in Ji], Section 4]. It is also easy to see that the intersection of 
rational relations may fail to be rational. Theorem ^ shows this failure to be 
total. 

Lemma 18 Let£ be any preferential relation. There exists a rational extension 
of £ for which a formula is inconsistent only if it is inconsistent for £. 

Proof: Let us choose some enumeration of triples of formulas a, (3 and 7 in 
which every triple appears an unbounded number of times. Let Kq be equal 
to £ . At every step i we define K i+ i in the following way. Let a, (3 and 7 
be the triple enumerated at step i. Unless Ki contains the pair a|~ 7 but 
contains neither a A |~ 7 nor a|~ -if), we shall take Ki + i to be equal to Ki. 
If Ki satisfies the condition above, we shall take Ki+\ to be the preferential 
closure of Ki U {a |~ f3}. Notice that, by Cautious Monotonicity, a A (3 K 7 
will enter Ki+t. It is clear that the Kfs provide an increasing sequence of 
preferential extensions of £. Let if<x> be the union of all the Kfs. Clearly Koo 
is a preferential extension of £. By construction, and since we took care of 
removing all counter-examples to the rule of Rational Monotonicity, K^ is 
a rational consequence relation. We claim that a formula a is inconsistent for 
i^oo (i.e., ah false is in K^) only if it is inconsistent already for £. Indeed, if 
a is inconsistent for K^ it must be inconsistent for some Ki, but Theorem || 
shows that, by construction, all Kfs have the same inconsistent formulas. | 



Theorem 6 If the assertion A is satisfied by all ranked models that satisfy all 
the assertions of K, then it is satisfied by all preferential such models. 

Proof: Let A = <$h e be as in the hypotheses. Let £ be the rational exten- 
sion of the preferential closure of K U {(5 h ^e}, whose existence is asserted by 
Lemma The assertion 5 1~ e is in £ since it is in any rational relation that 
extends K, by Theorem [s[ Since is obviously in £, we conclude that 

S is inconsistent for £ and therefore inconsistent for the preferential closure of 
K U {(5h _, e}- By Corollary [| A is preferentially entailed by K. | 
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4.3 Comparison with Adams' probabilistic entailment 

In this section we shall show that ranked models are closely related to Adams' 
probabilistic entailment described in Theorem then, provides an alter- 
native proof of Adams' axiomatic characterization of probabilistic entailment. 
There are some technical differences between Adams' framework and ours since 
Adams insists on allowing formulas as conditional assertions: for him the for- 
mula a is a synonym for true |~ a. We also insist on studying infinite knowl- 
edge bases whenever possible, where Adams restricts himself to finite knowledge 
bases. 

A probability assignment for the language £ is a probability measure on 
C yielded by some probability measure given on U. E. Adams proposed the 
following definitions. 

Definition 15 (Adams) A probability assignment p for the language C is said 
to be proper for a conditional assertion a |~ (3 iff p{a) > 0. It is proper for a 
set of conditional assertions iff it is proper for each element. If p is proper for 
A d = a |~ (3, we shall use p(A) to denote the conditional probability p(f3 | a). 

Definition 16 (Adams) Let K be a set of conditional assertions. We shall 
say that K is probabilistically consistent if and only if for any real number 
e > there exists a probability assignment p for C that is proper for K and such 
that, for all A in K, one has p{A) > 1 — e. 

Definition 17 Let K be a set of conditional assertions and A a conditional 
assertion. We shall say that K probabilistically entails A iff for all e > there 
exists 5 > such that for all probability assignments p for C which are proper 
for K and A, if p(B) > 1-8 for all B in K, then p(A) > 1 - e. 

In [Q , Adams studies extensively the relations between the two notions of prob- 
abilistic consistency and probabilistic entailment, at least for finite sets of condi- 
tional assertions. Here we shall only show the fundamental relation that exists 
between Adams' notions and ours. First, we shall make three easy remarks. 
The first one concerns only probabilistic notions and was claimed by Adams for 
finite knowledge bases but is true in general. 

Lemma 19 A set K of conditional assertions is probabilistically inconsistent 
iff it probabilistically entails any conditional assertion. 

Our second remark provides a first link between probabilistic notions and the 
notions introduced in this paper. It is essentially the soundness part of Adams' 
soundness and completeness result (see beginning of proof of 4.2 at page 62 
of 0). This is the easy direction. 

Lemma 20 Any conditional assertion preferentially entailed by K is probabilis- 
tically entailed by K. 
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Our third remark is the following. 



Lemma 21 If the conditional assertion a f~ j3 is in K and a |~ false is pref- 
erentially entailed by K then K is probabilistically inconsistent. 

Proof : Under the assumptions of the lemma, Lemma shows that a |~ false 
is probabilistically entailed by K. But for any probability assignment p that 
is proper for a f-° /3, p(a |~ false) is defined and equal to 0. Since K proba- 
bilistically entails a |~ false we conclude that there is an e > such that no 
probability assignment that is proper for K and a |~ /3 gives probabilities larger 
than 1 — e to all assertions of K. Since any probability assignment that is proper 
for K is also proper for a K (3 the conclusion is proved. I 

We shall now prove the converse of Lemma ^ in the case K is finite and 
probabilistically consistent. The basic remark is the following. Suppose W is a 
finite (i.e., the set S of states is finite) ranked model. Let e > be some real 
number. We shall describe a probability measure p e on S. The first principle 
that will be used in defining p e is that all states of the same rank will have equal 
probabilities. The second principle is that the weight of the set of all states of 
rank n, w n will be such that Wn+1 = e. The intuitive meaning of this choice 
(since e will approach zero) is that normal states are more probable than excep- 
tional states. There is clearly exactly one probability measure satisfying both 
principles above, for any given finite ranked model. The probability measure p £ , 
defined on states, yields a probability measure on formulas. It is clear that a for- 
mula a has probability zero under p e iff a is inconsistent in W , i.e., a false. 
Suppose a is consistent. Let us consider the conditional probability of (3 given 
a, which is well defined. If a Y^w P then this conditional probability is larger 
than 1 — e — e 2 — e 3 — . . . and therefore approaches one when e approaches zero. 
On the other hand, if a ty w (3, then this conditional probability cannot exceed 
1 — ^- where m is the number of states at the rank which is minimal for a. It 
is therefore bounded away from 1 when e approaches 0. 

Lemma 22 Let a finite probabilistically consistent knowledge base K be given 

and suppose A d = a f~ f3 is not preferentially entailed by K. Then, K does not 
probabilistically entail A. 

Proof: Let K and A be as described in the lemma. Let C be some logically 
finite sublanguage of C that contains a, and all propositions appearing in K. 
Relative to £', the hypotheses of the lemma are still true. By Lemmas |l8| and 
Theorem ||, there is a rational relation E that contains K and a [~ -i/3 and for 
which a formula is inconsistent only if it is inconsistent for K p . By Theorem ||, 
there is a finite ranked model, W that satisfies a f~ and all assertions of 
K but whose inconsistent formulas are exactly those of K p . Since a is not 
inconsistent for K p , the model W does not satisfy ah /3- Let W be the model 
obtained by extending the labeling function of W to the full language C in an 
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arbitrary way. We shall now apply the construction of p e described above on 
the model W. 

Using the model W and a sequence of e's approaching zero, we define a 
sequence of probability measures p e . Let us show that all assignments p e are 
proper for K and A. If 7 £ L', the assignment p e gives zero probability to 7 
iff 7 is inconsistent in W, i.e., inconsistent for K p . But K is probabilistically 
consistent and, by Lemma p e is proper for K. Since W does not satisfy A, 
its antecedent cannot be inconsistent in W' and p € is proper for A too. When 
e approaches zero, the conditional probabilities corresponding to each assertion 
of K approach 1 and the conditional probability corresponding to A is bounded 
away from 1. | 

That the result cannot be extended to infinite sets of conditional assertions 
follows from Adams' remark that his notion of probabilistic consistency does 
not enjoy the compactness property and from Corollary ^. Adams' example [Jj], 
pages 51-52] is closely related to the construction of Lemma |j The results of 
Adams presented in this section have been interpreted, in particular by p6[ , to 
mean that probabilistic semantics validate preferential reasoning. We certainly 
agree. But the results that will be presented now show, in our opinion, that 
probabilistic semantics support the claim that inference procedures should not 
only be preferential but also rational. Indeed we show, in Appendix [b], that some 
very natural probabilistic models always define rational relations and that, when 
the language C is countable, all rational relations may be defined by such models. 
Those models are non-standard probability spaces, in the sense of A. Robinson. 
Since no use of those models will be made in the paper, their treatment has 
been relegated to an appendix. 

5 The rational closure of a conditional knowl- 
edge base 

5.1 Introduction 

So far, we have argued for Thesis [l] and gathered much knowledge about rational 
relations, showing in particular that there is no obvious way to define a notion of 
closure satisfying Thesis |l|. In this section we shall show that there is a natural 
notion of closure (called rational closure) that satisfies Thesis [jj We shall study 
it and prove that it possesses many very elegant mathematical properties. We 
shall, then, evaluate the value of rational closure as an answer to the question 
of the title. In conclusion, we shall propose Thesis |[ that claims that any 
satisfactory answer is a superset of rational closure. In other terms we think that 
any reasonable system should endorse any assertion contained in the rational 
closure, but it may also endorse some additional assertions. At present, we do 
not know of any natural construction satisfying Thesis [fl other than rational 
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closure. 

A first possible answer is rejected in 5.2. This result appeared in p]|. The 
remainder of the paper describes rational closure. In 5.3 a partial ordering 
between rational relations is defined, which captures the notion of a relation 
being preferable to (i.e., smaller, less adventurous, more reasonable tha n) an- 
other one. The rational closure of a knowledge base is then defined in 5.4 as the 
rational extension of a knowledge base that is preferable in the ordering defined 
in Section to all other rational extensions. Not every knowledge base has 
a rational closure, but in Section 5.6 it will be shown that any admissible (see 
Definition [n]) knowledge base has a rational closure. By Lemma [?], then, any 
finite knowledge base has a rational closure. We claim that the rational closure 
of a knowledge base, when it exists, provides a reasonable answer to the question 
of the title. Global properties of the operation of rational closure are described 
in [5.5[ . These results, concerning the global be hav ior of a nonmonotonic infer- 
ence operation, are the first of their kind. In 5.6 an algorithmic construction 
of the rational closure of an admissible knowledge base is described. This algo- 
rithmic description essentially replaces and improves upon the proof-theoretic 
description of A corrected and generalized model-theoretic construction, 
first described in is proposed in 5.7. Section 5.8 presents an algorithm to 
compute the rational closure of a finite knowledge base and discusses complexity 
issues. Section 
examples. Section I 

J. Pearl proposes his own version of the rational closure construction that had 
been described in [Il8||. 



.9| d iscusses the appeal of rational closure and provides some 
concludes by considering topics for further research. In p7| 



5.2 Perfect extensions 

All that has been done so far does not allow us to give a satisfactory answer to 
the question of the title. Let K be a set of conditional assertions. We would like 
to define a consequence relation K, the rational closure of K, that contains all 
the conditional assertions that we intuitively expect to follow from K. At this 
point the reader should be convinced that K should be a rational consequence 
relation that extends K. Any such relation obviously also extends K p . It seems 
that we would also like this rational extension of K to be as small as possible. 
Unfortunately Theorem ^| shows that the intersection of all rational extensions 
of K is exactly K p and therefore not in general rational and highly unsuitable 
as shown in Section |3.5| . There is obviously a maximal such extension: the full 
consequence relation, (i.e., a K j3 for all a, j3 in C) but this is certainly not the 
one we are looking for. Can we find out a number of properties that we would 
like K to possess, in order to, at least, narrow the field of possibilities? We shall 
look both for local properties of K with respect to K and for global properties 
of the mapping K h K. The sequel will present a proposal for the definition of 
K and proofs that it enjoys both local and global (in particular a strong form 
of cumulativity) properties. 
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If K p happens to be rational, then we probably have no reason to look further 
and should take K to be equal to K p . If K p is not rational, then there is an 
assertion a |~ (3 in K p , and a formula 7 such that neither a A 7 ]y (3 nor ah n 7 
are in K p . It seems that the right thing to do, in most such cases, is to introduce 
a A 7 |~ /? in K. One may try to require that any assertion in K — K p be of 
the form a A 7 |~ (3 where «K (3 is in K p , i.e., that any assertion in K — K p 
have support in K p . It will be shown that this may well be impossible. Let us 
encapsulate this idea in definitions. 

Definition 18 An assertion a |~ (3 is said to be supported by (or in) K p iff 
there is a formula 7 such that a|=7 and 7 |~ (3 is in K p . 

Definition 19 A rational extension^.' o/K is called perfect iff every assertion 
o/K' is supported by K p . 

We may present the following disappointing result. 

Lemma 23 There is a finite conditional knowledge base that has no rational 
perfect extension. 

Proof : Let C be the set of all prepositional formulas built out of the set of four 
propositional variables: {a, 6, c, d}. Let W be the preferential model with three 
states: {s, t, u}, in which s -< t (and this is the only pair in the relation -<) and s 
satisfies only o, t satisfies only b and u satisfies only c and d. Let K be the set of 
all conditional assertions satisfied in W . We claim that K has no rational perfect 
extension. Notice, first, that W satisfies a V b |~ — ifo. This assertion is therefore 
in K. Any ranked model satisfying a V b K ~b must satisfy at least one of the 
following two assertions: a V c h -ic or & V c |~ -16. Any rational extension of 
K must therefore contain one of the two assertions above. But a V c |~ — >c has 
clearly no support in K p and therefore any perfect rational extension of K must 
contain: b V c |~ ~~<b. But W satisfies c f~ d and any ranked model satisfying 
both b V c h ^b and c H must also satisfy b V c \^ d. Any perfect rational 
extension of K must therefore contain this last formula but it clearly lacks 
support in K p . We conclude that K has no perfect rational extension. | 

It is therefore reasonable to look for less than perfect extensions. Let us first 
examine perfection concerning two special kinds of formulas. The following is 
easily proved. 

Lemma 24 An assertion of the form a \^ false is supported by K p iff it is in 
K p . An assertion of the form true f~ a is supported by K p iff it is in K p . 

We shall propose a construction of K such that K docs not contain any formula 
of the form a \^ false or of the form true f~ a that is not in K p . 
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5.3 Ordering rational relations 

In this section we shall define a strict partial ordering between rational relations. 
This ordering captures the notion of a relation being preferable to, i.e., less ad- 
venturous than another one. An intuitive explanation will be given immediately 
after the definition. For the rest of this section we shall write a < (3 for ( or in) 
K to mean the assertion a V (3 |~ -ij3 is in K. We shall write a < (3 for ( or in) 
K when it is not the case that (3<a in K. 

Definition 20 Let K and Ki be two rational consequence relations. We shall 
say that Kq is preferable to K\ and write Kq -< K\ iff: 

1. there exists an assertion a|~ (3 in K\ — Kq such that for all 7 such that 
7 < a for Kq, and for all 8 such that 7K (5 is in Kq, we also have 7K 8 
in K\, and 

2. for any 7, 8 if '7 f~ 8 is in Kq — K\ there is an assertion p |~ rj in K\ — Kq 
such that p < 7 for K\ . 

The intuitive explanation behind Definition |2(] is the following. Suppose two 
agents, who agree on a common knowledge base, are discussing the respective 
merits of two rational relations Kq and K\. A typical attack would be: your 
relation contains an assertion, a |~ (3, that mine does not contain (and therefore 
contains unsupported assertions). A possible defense against such an attack 
could be: yes, but your relation contains an assertion 7 1~ 8 that mine does not, 
and you yourself think that 7 refers to a situation that is more usual than the 



one refered to by a. Such a defense must be accepted as valid. Definition 20 
exactly says that the proponent of Kq has an attack that the proponent of K\ 
cannot defend against (this is part [l]) but that he (i.e., the proponent of Kq) 
may find a defense against any attack from the proponent of K\ (this is part || 
of the definition) . 

Lemma 25 The relation -< between rational consequence relations is irreflexive 
and transitive. 

Proof : Irreflexivity follows immediately from Condition [|. For transitivity, let 
us suppose that Kq -< K\ , with a f~ (3 the witness promised by Condition [l] and 
that K\ -i, K2 with 7 1~ 8 as a witness. Our first step will be to show that there 
exists an assertion e f~ £ in Ki — Kq such that e < a in Kq and e < 7 in K\ . 
We shall have to consider many different cases. 

1. Suppose 7 < a. in K 2 . 

(a) If 7 < a is not in Kq, then 7 < a is a suitable s f~ £. 

(b) If 7 < a is in Kq, then 7^ i5 is a suitable e|~ C? since if it were in 
Kq it would be in K\. 
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2. Suppose therefore that 7 < a is not in A2, i.e., for A2, a < 7. 

(a) If 7 < a is in Ai, then it is in K\ — K2 and there is an assertion 
£ |~ 77 in A2 ^ Ai such that £ < 7 V a in A2. 

i. If £ < 7 V a is not in Ao, then it is a suitable e |~ £. 

ii. If £ < 7 V a is in A , then £ < a in A and we have both that 
£ < 7 V a in Ki and that £ |~ 77 cannot be in Ao, otherwise it 
would be in K\. We conclude that £ h 77 is a suitable eK C- 

(b) Suppose therefore that 7 < a is not in Ai, i.e., for Ai, like for A2, 
at < 7. 

i. If /3 is in A2, then it is a suitable e|~ £. 

ii. If a |~ /3 is not in A2, then it is in K\ — K2 and there is a £ [ — ' 57 
in A2 — Ai such that £ < a in A2. 

A. If £ < a is not in Ao, then it is a suitable C since, in K\, 
(Va<«<7. 

B. If £ < a is in Kq then £ |~ 77 is a suitable C since £ |~ 77 
cannot be in Ao, otherwise it would be in K%. 

We have now proved the existence of an assertion e |~ £ with the desired 
properties. Let us proceed to the proof that Ao -< K2. For property [l], we claim 
that £ K £ provides a suitable witness. It is indeed in K2 — -Ko by construction. 
Suppose now that £ < e in Ao- Then £ < a in Ao and therefore £ < e in Ai. 
Therefore £ < 7 in K\. If £ f~ 77 is in Ao, then it must be in K\ since £ < a 
in Ao and also in A2 since £ < 7 in K\. This concludes the verification of 
Condition |l|. 

For Condition ||, suppose that tp |~ 9 is in Ao — A2 . We have to find a £ f~ 77 
in A2 — Ao such that £ < </? in A2. We shall consider a number of different cases. 

1. If e < ip in A2, then e f~ £ is a suitable £ h 1 77. 

2. Suppose then that e < ip is not in A2, i.e., p> < e for A2. 

(a) Suppose, first that e < ip is in Ai, therefore in K\ — A2. There is 
then an assertion p |~ r in A2 — Ai such that p < e V <£> in A2. 

i. If p < e V is in Ao, then p < a in Ao and we conclude that 
p \^ t is not in Ao, otherwise it would be in K\. We conclude 
that p |~ r is a suitable £ f~ 77. 

ii. If /? < e V <y3 is not in Ao, then it is a suitable £ K 77. 

(b) Suppose, then, that e < p> is not in K±, i.e., for Ai, p> < e. 

i. If e < 95 is in Ao, then it is in Ao — K\. Therefore there is an 
assertion p |~ r in K\ — Kq such that p < e V p in Ai . But then 
p < 7 in Ai and we conclude that p \^ r is in A2 and that p < p 
in A2. The assertion p \^ r is a suitable £ K 77. 
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ii. Suppose, then that, on the contrary, e < <p is not in Kq, i.e., 
ip < e in Kq, as in K\ and K%. 

A. Suppose first that <p |~ is in ifi, therefore in ifi — 1^2- 
Then, there is an assertion p |~ t in X2 — ifi, such that 
p < ip in 1^2 • There are two cases. If p < <p is in Kq, then 
p < e in Kq , and p |~ r is not in Kq , otherwise it would be in 
K±, since p < e < a in Kq. The assertion p r is a suitable 
£ K 77. If, on the other hand p < <p is not in Kq, then it is 
in K2 — Kq, and it is a suitable £ [~ r\. 

B. Suppose now that <p |~ is not in Xi, therefore in Xo — Xj.. 
There is an assertion p |~ r in — -Ko, such that p < ip in 
_ftTi. But p<(p<e<7in iiTi and since p |~ r is in A'i it 
must be in i^- Also, since p < ip is in i^i, it must be in K^. 
We see that p |~ r is a suitable £ |~ 77. 



5.4 Definition of rational closure 

We may now define the rational closure of a knowledge base. 

Definition 21 Let K be an arbitrary knowledge base. If there is a rational 
extension K of K that is preferable to all other rational extensions o/K, then 
K will be called the rational closure o/K. 

Notice first that the rational closure of a knowledge base is unique, if it exists, 
since preference is a partial ordering. Notice then that there are knowledge bases 
that do not have a rational closure. Example [l] will show this. In Section 5.6 



we shall show that admissible knowledge bases, including all finite knowledge 
bases, have a rational closure. 

Example 1 Let C be the prepositional calculus built upon the variables p n 
where n is an arbitrary integer (i.e., positive or negative). Let N be the knowl- 
edge base that contains all assertions of the form p n |~ p„+2 and of the form 
Pn l~ for ah integers n. We shall show that N has no rational closure. 

We shall first prove a lemma about invariance of the operation of rational 
closure under renaming of the proposional variables. This lemma is of indepen- 
dent interest. 

Definition 22 1. A renaming of the propositional calculus C is a bijection 
of the propositional variables. 

2. Let f be a renaming of C The formula obtained from a by substituting 
f(p) f or the propositional variable p will be denoted by f(a). 
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3. Let f be as above and a h a conditional assertion. The assertion /(a) h 
/(/3) will be denoted by f(a h 

4- Let f be as above and K a consequence relation. The relation f(K) will 
be defined by f(K) = {/(ah (3) | ah P S K}. 



Lemma 26 (Invariance under renaming) Let f be a renaming of C. 

1. Let Kq and K\ be rational consequence relations. Then Kq -< K\ iff 

2. Let K be a consequence relation and K its rational closure ,then f(K) is 
the rational closure of f{K) 

3. Let K be a consequence relation which is invariant under f , namely f(K) = 
K ,then its rational closure (if it exists) is invariant under f. 

Proof: The proof is immediate from the definitions, noting that / is also a 
bijection of the set of all consequence relations. | 

Lemma 27 The knowledge base N defined above has no rational closure. 

Proof: We shall reason by contradiction. Suppose R is the rational closure of 
N. From Lemma ^ in the sequel (the proof of which does not depend on the 
present lemma), we know that there is no assertion of the form ah false in 
R that is not in N p . Using a construction very similar to the one used in the 
proof of Lemma [lj one may build, for any integer n, a preferential model of N, 
containing a top state that satisfies p n . Therefore, for any n, p n is consistent 
for R. 

Remember that a < b is the assertion a V b h ~>b. We shall write a < b to 



mean that a V b h ~^b is in R. If follows from results of Section 3.6 that, on 
formulas that are consistent for i?, the relation < is a strict modular ordering. 
Notice, also, that, for any n, the assertion p n +2 < Pn belongs to N p , since both 
Pn h Pn+2 and p n+2 h ~^Pn are in N p . Therefore p n+2 < p n - There are, in R, 
two infinite (in both directions) chains (for <), one containing the variables of 
odd index, the other one containing those of even index. Since < is modular, 
we may consider only four cases: 

1. For every even n and odd k, p n > pk- Let / be the renaming of C given by 
f(m) = m + 1. Clearly f(N) = N. Hence, by Lemma ^ we must have 
f{R) = R. But this last statement implies p n > pk for even n and odd fc, 
and therefore implies that all p„'s are inconsistent for R. A contradiction. 

2. For every even n and odd k, p n < pk- The argument is exactly as in case [j], 
systematically interchanging 'odd' and 'even'. 
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3. There is an odd k ,and there are even m and n such that p n < pk < p m . In 
this case, define a renaming / by f(l) — I for odd I and f(l) = l + m — n for 
even I. The contradiction is as above by noting that / transforms p n < Pk 
into p m <p k . 

4. None of the above is true. In such a case one may see that there must 
exist an even m ,and odd i and j such that pi < p rn < pj. The argument 
is exactly as in case ||, systematically interchanging 'odd' and 'even'. 

I 

5.5 Global properties of the operation of rational closure 

First, we show that rational closure possesses a loop property analogous to the 
property discussed in |l7], Section 4], This is a powerful property that one is 
happy to have. 

Lemma 28 (Loop property) Let Ki for i = 0, . . . , n — 1 be knowledge bases 
such that, for any i, Ki+i C Ki, where addition is understood modulo n. Then 
for any i,j, one has Ki = Kj. 

Proof: Let K < K' mean that either K -< K' or K = K' . Since Ki is a rational 
extension of -fQ+i, we have Ki+i ^ Ki, for all i's (modulo n). We conclude that 
the rational closures of all the K»'s are equal. | 

The following property of reciprocity is the special case n = 2. 

Corollary 4 If X C F andY CI, then X = Y . 

The following property of cumulativity is equivalent to reciprocity in the presence 
of inclusion (i.e., K C K). 

Corollary 5 IfXCYCX then X = Y. 

The meaning of Corollary || is that one may add to a knowledge base anything 
that is in its rational closure without changing this closure. We may now show 
that, in two different respects, rational closure is close to being perfect. 

Lemma 29 The consequence relation K, if it exists, contains an assertion of 
the form true |~ a only if this assertion is in K p . 

Proof: Suppose an assertion of the form above is in K. We shall show that it 
must be in any rational extension of K and will conclude by Theorem^. Suppose 
K 1 is a rational extension of K and true \^ a is in K — K' . Since K', we 
know there is an assertion 7 f~ 6 in K' — K such that 7 < true in K' . But this 
means true |~ false is in K', and contradicts the fact that true |~ a is not in 
K>. I 

Lemma 30 The consequence relation K, if it exists, contains an assertion of 
the form ah false only if this assertion is in K p . 
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Proof: Let V and T be preferential models defining the relations K and K p 
respectively. Such models exist by Theorem [I]. Let U be the model obtained 
by putting T on top of V, i.e., every state of V is less than every state of 
T. One easily sees that U satisfies the smoothness property and is therefore a 
preferential model. It defines a preferential relation S. An assertion of the form 
false is in S only if it is in K p , since T is a submodel of U. If a is not 
inconsistent in K then for any 0, ah is in S iff it is in K. By Lemma [l8], 
there is a rational extension R of S with the same set of inconsistent formulas. If 
one looks at the construction described in the proof of this lemma, one sees that 
it will add to S only assertions with antecedent inconsistent in K. Therefore, 
if a is not inconsistent in K, for any 0, a |~ is in R iff it is in K. Now, R 
is a rational extension of K. If R is equal to K, we are through. Suppose not. 
Then we have K -< R. Suppose now that a |~ false is in K — R. There must be 
an assertion 7 [~ 6 in R — K such that 7 < a in R. But 7 f-° 6 in R — K implies 
that 7K false is in K and 7 1~ S is in K. A contradiction. | 



5.6 Admissible knowledge bases and their rational closure 

In this section, we show that an admissible (see Definition |ll|) knowledge base 
has a rational closure and that this rational closure may be defined in terms of 



the ranks of the formulas, as defined in Section 2.6. This provides a useful and 



elegant characterization of the rational closure of an admissible knowledge base. 

Theorem 7 Let K be an admissible conditional knowledge base. The rational 
closure K 0/ K exists and is the set S of all assertions a f-° such that either 

1. the rank of a is strictly less than the rank of a A ->0 (this includes the case 
a has a rank and a A -*0 has none), or 

2. a has no rank (In this case a A ->f3 has no rank either). 

Proof : Suppose indeed that every formula consistent with K p has a rank. We 
have many things to check. First let us prove that S contains K. If a |~ (3 is 
in K and a has rank r, then C T contains a K and entails true [~ ol — * 0- 
Therefore a A ->0 is exceptional for C T , and has rank strictly larger than r. 

We should now check that S is rational. For Left Logical Equivalence, 
Right Weakening and Reflexivity the proof is easy. For Cautious Mono- 
tonicity, notice that if a |~ is in S, then a and a A have the same rank. For 
And and Or, notice that the rank of a disjunction is the smaller of the ranks 
of its components. For Rational Monotonicity, notice that if a f~ —>0 is not 
in S, then a and a A have the same rank. 

We must now check that if R is a rational extension of K that is different 
from S then S -< R. Let R be such an extension. We shall first show that S 
and R must agree on all assertions whose antecedents have no rank (the notion 
of rank is always defined by reference to K). Indeed, by construction, any such 
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assertion is in S, and it is preferentially entailed by K since K is admissible. It 
is therefore in R. We conclude that S and R must differ for some assertion that 
has rank. Let r be the smallest rank at which S and R differ, i.e., the smallest 
rank of an a such that there is a (3 such that a |~ [3 S (S — R) U (i? — S). We 
have two cases to consider, either there is a formula a of rank greater or equal 
to t such that, for all formulas (3 of rank greater or equal to r, a < (3 in i?, or 
there is no such formula. 

Suppose there is such an a. Our first claim is that, for any (3 of rank greater 
than t, the assertion a < (3 is in R. Consider indeed a ranked model W that 
defines R. Let W" be the supermodel obtained from W by adding to W, at each 
level I a state labeled with world w for all worlds w that label a state of rank 
less than I in W. It is clear that W" is ranked and defines the same relation 
as W, and, in W", every label that appears at some level I also appears at all 
greater levels. Let W' be the submodel of W" that contains all those states of 
level (rank in W") greater or equal to the minimal level I at which some state 
satisfies a. It clearly satisfies the smoothness property (for this we needed to 
go through the construction of W"). Since a formula is satisfied in W" at some 
level less than / iff it is of rank less than r, no antecedent of an assertion of 
C T is satisfied at any level less than I. But W" is a model of K and therefore 
W' is a model of C T . But C T preferentially entails true |~ -i/3. The model 
W therefore satisfies true f~ ~^(3 but not true f~ _, ck- It therefore also satisfies 
a < (3. But the antecedent of this last assertion has rank greater or equal to t, 
and therefore no state of W" that is not in W satisfies it. Therefore a < (3 is 
satisfied by W" and is an element of R. satisfies Our second claim is that there 
is an assertion 7 1~ 5 in R — S, such that 7 is of rank r and 7 < a in R. We 
consider two cases. 

1. There is an assertion £ f~ V m S ~ R with £ of rank r. Then £ A ^77 has 
rank greater than r, and by our first claim, a < £ A ~^r\ is in R. But £ |~ r\ 
is not in R, and therefore we must have a < £ for R. This last assertion is 
not in S since both a and £ have rank r. The assertion a < £ is a suitable 
7 1~ 5. 

2. There is an assertion £ rj in i? — S 1 with £ of rank r. If £ < a in i?, then 
£ |~ rj is a suitable 7 1~ S. Suppose, then, that a < £ in R. Since £ has 
the same rank as a, a < £ is in i? — 5* and a suitable 7 [~ 

We may now conclude that S 1 -< i?. The assertion 7 f~ <5 fulfills the require- 
ments of Condition [l] of Definition since 7 has rank r. For Condition ||, 
suppose £ K 77 is in — i?, then £ must be of rank greater or equal to r and 
£ A — 177 is of rank greater than r. By our first remark we conclude that a < £ A ^77 
for i?. It is a matter of elementary properties of rational relations to check that 
if a < £ A ->r] is in i?, but £ |~ 77 is not, then a < £ for i?. Since 7 < a in R, we 
conclude that 7 < £ for i?. 



35 



Suppose now that there is no such a. Take any formula 7 of rank r. There 
is a formula S of rank greater or equal to r such that 6 < 7 for R. But this 
assertion is then in R — S. It satisfies Condition [j] of Definition since its 
antecedent has rank r. Suppose now cp \^ 8 is m S — R. Then ip is of rank at 
least r. If it is of rank r, there is a formula 7r of rank at least r such that it < ip 
is in i?, but not in 5 and this provides the witness requested by Condition |[ If 
it is of rank greater than r, then the assertion S < 7 defined just above will do. 
I 



5.7 A model-theoretic description of rational closure 

We shall describe here a model-theoretic construction that transforms a pref- 
erential model W into a ranked model W by letting all states of W sink as 
low as they can respecting the order of W, i.e., ranks the states of W by their 
height in W . We shall show that, under certain conditions, the model W de- 
fines the rational closure of the relation defined by W. This construction is 
clearly interesting only when the model W is well-founded. We know that, in 
this case, the relation defined by W indeed possesses a rational closure (The- 
orem [7] and Lemma Q). It would have been pleasant to be able to prove the 
validity of such a construction on an arbitrary well-founded preferential model. 
Unfortunately we are not able to show this in general, but need to suppose, in 
addition, that the preferential relation defined by W is well-founded (see Def- 
inition p|) . This is quite a severe restriction, since we have seen at the end of 
Section [2.3] that finitely-generated relations on arbitrary languages £ are not 
always well-founded. When the language C is logically finite, we know all pref- 
erential relations are well-founded. Given a well-founded preferential relation, 
the construction may be applied to any of its well-founded models. 

Let P be a well-founded preferential relation and W = (5, Z, -<) any well- 
founded preferential model that defines P. We shall define, for any ordinal r, 
two sets of states: U T and V T . Those sets satisfy, for any r, U T C V T C U T+ \. 
The set U T contains, in addition to the elements of previous Vs, the states that 
are minimal among those states not previously added. The set V T contains, in 
addition to the states of U T , all states that satisfy only formulas already satisfied 
by states previously considered. 

U T ^ (J V p 

U {s e S I Vf G S such that t -< s, there is a p < r such that t e V p } (19) 

V r d = {s S S I Va e L such that s |= a, 3t £ U T such that 1 1= a} (20) 

Since the model W is well-founded, every state s € S is in some V T . Let the 
height of a state s G S (in VF) be the least ordinal r for which s £ V T . We shall 
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now show that there is a close relationship between the rank of a formula a 
in P (see definition following Definition |l^) and the height in W of the states 
that satisfy a. For any ordinal t, we shall denote by W T the substructure of 
W consisting of all states of height larger or equal to r. Notice that, since W 
is well-founded, W T is a preferential model. Notice also that all elements of 
U T — Up< T are minimal elements of W T . 

Lemma 31 Let r be an ordinal. Let a be a formula of rank at least t and (3 be 
any formula. 

1. No state of height less than t satisfies a. 

2. The model W T satisfies ah [3 iff a K @ is preferentially entailed by C T . 
In particular, if a has no rank, no state in S satisfies a. 

Proof: It proceeds by simultaneous ordinal induction on r. Suppose both 
claims have been proved for all ordinals p < r. Let us prove our first claim. Since 
a has rank at least r, for any p, p < r, C p preferentially entails true |~ —tot. By 
the induction hypothesis (item 2), W p satisfies true |~ ->a. Therefore no state 
of Up — Ucr<p satisfies a. If there were a state s of height p < t satisfying 
a, there would be a state t of U p — {J IJ<p V a satisfying a. We conclude that no 
state of height less than r satisfies a. 

For the second claim, by Lemma ||, a f~ (3 is preferentially entailed by Co 
(i.e., in P, i.e., satisfied by W) iff it is preferentially entailed by C T . By the first 
claim, a |~ (3 is satisfied by W iff it is satisfied by W T . | 

Lemma 32 A formula a has rank r in P iff there is a state s G S of height r 
that satisfies a and there is no such state of height less than t. 

Proof: We shall prove the only if part. The if part is then obvious. First, 
remark that if K is a preferential relation that contains the assertion a\/(3 1~ ->a 
, then it contains the assertion true |~ -ict. This is easily shown by preferential 
reasoning. Suppose now that a has rank r. Lemma |3l] shows that no state of 
height less than r satisfies a. We must show that there is a state of height r 
satisfying a. Let [3 be any formula of rank larger or equal to r that is minimal 
with respect to < among those formulas. There is such a formula since the set is 
not empty [a is there) and < is well-founded. Since a is not exceptional for C T , 
the assertion true |~ ->q is not preferentially entailed by C T and therefore the 
assertion aV/3K ~<ot is not preferentially entailed by C T . But aV/3 has rank r 
and, by Lemma W T does not satisfy aVf3 1~ ->a. There is, therefore, in W T a 
state s satisfying a such that no state t in W T , t -< s, satisfies (3. We shall show 
that s is minimal in W T and has therefore height t. Suppose s is not minimal in 
W T . There would be a state t minimal in W T such that t -< s. This state t has 
height r and, by construction, it satisfies some formula [3' that is not satisfied 
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at any smaller height. By Lemma 31, /3' has rank larger or equal to r, and the 
formula (3 V (3 1 has rank larger or equal to r. Since j3 V j3' < (3, the minimality 
of (3 implies that (3 < (3 V (3 1 . In other terms, /3 V /3' |~ [3. But the state t, in PF, 
satisfies (3' and is minimal among states satisfying (3W (3' . Therefore t satisfies 
(3. A contradiction. | 

Lemma |3^ shows that, given a well-founded preferential relation (resp. a 
finite knowledge base) , and a well-founded preferential model W for it (resp. for 
its preferential closure), one may build a ranked model for its rational closure 
by ranking the states of W by their depth. 



5.8 Computing rational closure 

We shall now provide an algorithm for deciding whether an assertion is in the 
rational closure of a finite knowledge base. The notation E(C) has been defined 
following Definition Lemma [?] and Theorem fj] show that, given a finite 
knowledge base K and an assertion f3 the following algorithm is adequate. 

C = K; 

while a is exceptional for C and E{C) ^ C, C := E(C); 

if a A -<f3 is exceptional for C then answer yes else answer no. 

The only thing left for us to implement is checking whether a formula is 
exceptional for a given finite knowledge base. The next lemma shows this is 
easily done. 

Definition 23 Let A be the conditional assertion a\~^ (3. The material coun- 
terpart of A, denoted by A, is the formula a — > (3, where — >, as usual, denotes 
material implication. If K is a set of assertions, its material counterpart K is 
the set of material counterparts o/K. 



Lemma 33 Let K be a conditional knowledge base and a a formula. Then 
K \= a iffH. preferentially entails true ct. 

Proof: The if part follows from the fact that any world satisfying K and 
not a provides a one state preferential model satisfying K and not satisfying 
true a. For the only if part suppose K |= a. By compactness, there is a 
finite subset of K that entails a. By rules S, And and Right Weakening we 
conclude that K preferentially entails true h a. | 

Corollary 6 Let K be a conditional knowledge base and a a formula. The 
formula a is exceptional for K.iffK.\= ->a. 
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We see that, if K contains n assertions, in the previous algorithm, we may go 
over the while loop at most 0{n) times. Each time we shall have to consider 
at most n + 1 formulas and decide whether they are exceptional or not. The 
whole algorithm needs at most 0(n 2 ) such decisions. In the most general case 
all such decisions are instances of the satisfiability problem for propositional 
calculus, therefore solvable in non-deterministic polynomial time (in the size 
of the knowledge base K times the size of the formulas involved). Therefore, 
even in the most general case, the problem is not much more complex than the 
satisfiability problem for propositional calculus. These results may be improved 
if we restrict ourselves to assertions of a restricted type. For example, if the 
assertions of K are of the Horn type (we mean their material counterpart is a 
Horn formula), and the assertion ah (3 is of the same type, then, since each de- 
cision may be taken in polynomial deterministic time, the whole algorithm runs 
in deterministic polynomial time. The complexity discussion above is mainly 
of theoretical interest. The important practical question is: given a fixed large 
knowledge base, what information, of reasonable size, should be precomputed 
to allow efficient answers to queries of the type: is an A in the rational closure? 
The pre-computation of the different C n sub-bases would already reduce the 
exponent of n in the complexity of the algorithm by one. 

J. Dix noticed that the algorithm just presented for computing the rational 
closure of a finite knowledge base may be used to compute the preferential 
closure of such a knowledge base, since, by Corollary ^ and Lemmas ^ and [50], 
the assertion a |~ j3 is in K p iff the assertion a |~ false is in the rational closure 
of the knowledge base KU{ah ^P}- 

5.9 A discussion of rational closure 

We have so far shown that rational closure provides a mathematically elegant 
and effective answer to the question of the title that satisfies Thesis |l|. It is now 
time to evaluate whether it provides an answer that matches our intuitions. 
We shall first present two now classical knowledge bases, describe their rational 
closure and examine whether they fit our intuitions. Then, we shall discuss the 
way rational closure treats inheritance of generic properties to abnormal indi- 
viduals. Finally, we shall try to address the question of whether our formalism 
is suitable to describe domain knowledge. 

Example 2 (Nixon diamond) Let our knowledge base consist of the follow- 
ing two assertions. 

1. republican f~ -^pacifist 

2. quaker |~ pacifist 

It is easy to see that none of the assertions of the base is exceptional, but that the 
formula republicanAquaker is exceptional. From this we deduce that neither the 
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assertion republican A quaker f~ pacifist nor the assertion republican A quaker K -^pacifist 
is in the rational closure. This seems the intuitively correct decision in the 
presence of contradictory information. In fact, if we know somebody to be 
both a Quaker and a Republican, we (i.e., rational closure) shall draw about 
him only conclusions that are logically implied by our information. Rational 
closure endorses worker A republican f~ -^pacifist, meaning that, since we have 
no information on the pacifism of workers, we shall assume that Republican 
workers behave as Republicans in this respect. We (i.e., rational closure) also 
endorse pacifist |~ -^republican, meaning we are ready to use contraposition in 
many circumstances. We do not have -^pacifist f~ republican, though, and quite 
rightly, since Republicans may well be a small minority among non-pacifists. 
We have true |~ -i (republican A quaker), meaning we think being both a Re- 
publican and a Quaker is exceptional. Wc endorse republican |~ -^quaker and 
quaker |~ ^republican, that are also intuitively correct conclusions. If we add 
to our knowledge base the fact that rich people are typically Republicans, we 
shall deduce that rich people are typically not pacifists, meaning we endorse a 
restricted form of transitivity. We shall also deduce that Quakers are typically 
not rich, which is perhaps more debatable. We shall not conclude anything 
about the pacifism of rich Quakers though, since rich Quakers are exceptional. 
We shall not conclude anything either concerning rich Quakers that are not 
Republicans, which is more debatable. If we want to conclude that rich non- 
Republican Quakers are pacifists, we should add this assertion explicitly to the 
knowledge base. The addition will not interfere with previously discussed as- 
sertions. 

Example 3 (Penguin triangle) Let our knowledge base consist of the fol- 
lowing three assertions. 

1. penguin f~ bird 

2. penguin f~ ^fly 

3. bird K fly 

The first two assertions are exceptional, the last one is not. It follows that we 
(i.e., rational closure) endorse the following assertions: fly f~ -^penguin (a case of 
contraposition) , ^/Z?/ f~ -*bird (another case of contraposition), ^fly f~ ^penguin 
(penguins are exceptional, even among non- flying objects), bird f~ -^penguin 
(penguins are exceptional birds), ->bird -^penguin (penguins are exceptional 
also among non-birds), birdhpenguin f~ -^fly (this is an intuitively correct pre- 
emption: we prefer specific information to non-specific information), penguinAblack |~ "'fly 
(black penguins don't fly either, since they are normal penguins), birdhgreen |~ fly 
(green birds are normal birds). 

The following assertions are not endorsed: bird A ^fly |~ penguin (there 
could be non- flying birds other than penguins) , bird A ^fly |~ ^penguin (seems 
intuitively clear), penguin |~ fly (obviously). 
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A more general reflexion suggests the following. Theorem [7] shows that, in 
the rational closure, no information about normal cases may be relevant to 
abnormal cases. It is a very intriguing question whether human beings obey 
this rule of reasoning or not. A specific example has been discussed by J. Pearl 
in a personal communication. It probably goes back to A. Baker. Suppose we 
know that most Swedes are blond and tall. If we are going to meet Jon, whom 
we know to be short and to come from Sweden, should we necessarily expect 
him to be fair? The answer endorsed by rational closure is not necessarily, since 
short Swedes are exceptional and we have no specific information about such 
cases. We do not know how people generally handle this and, even if we knew, 
it is not clear that AI systems should react in exactly the same way: people 
are, after all, notoriously bad with statistical information. The answer to the 
question how should people behave in this case, if they were smart and had all 
the relevant information, depends on the sociobiology of the Swedish population 
and is not relevant either. There is very solid ground, though, to claim that, in 
the framework described here, in which a knowledge base contains only positive 
conditional assertions, the only sensible way to handle this problem is not to 
expect anything about the color of Jon's hair. The reason is that, if we ever find 
out that most short Swedes are blond (or dark, for that matter) it will be easy 
enough to add this information to our knowledge base. On the contrary, had we 
chosen to infer that Jon is expected to be blond, and had we found out that half 
of the short Swedes only are fair, we would not have been able to correct our 
knowledge base to remove the unwanted inference: adding the fact that most 
short Swedes are not blond being obviously incorrect. 

Since, by looking at a number of examples, we have gathered some experi- 
ence on the behavior of rational closure, we would like to propose the following 
strengthening of Thesis |l|. 

Thesis 2 The set of assertions entailed by any set of assertions K is a rational 
superset of K. 

Thesis ^ means that a reasonable system should endorse any assertion contained 
in the rational closure, but it may also endorse some additional assertions, as 
long as it defines a rational relation. The search for natural constructions sat- 
isfying Thesis || but providing more inheritance than rational closure is open. 

The main question that has not been addressed yet is whether conditional 
knowledge bases are suitable to describe domain knowledge. Undoubtedly much 
work still has to be done before we may answer this question satisfactorily. We 
shall only try to express here why we think the answer may well be positive. 
Representing common sense knowledge is far from trivial in any one of the exist- 
ing formalisms, such as Circumscription or Default Logic. Indeed to represent 
any substantive piece of common sense knowledge in one of those formalisms, 
one needs to be an expert at the mechanics of the formalism used, and they differ 
greatly from one formalism to the next. Deciding on the different abnormality 
predicates in Circumscription and the relations between them, or working out 
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the default rules in Default Logic so as to ensure the correct precedence of de- 
faults needs the hand of an expert. In the formalism proposed here, conditional 
knowledge bases, the treatment is much simpler since abnormality predicates do 
not appear explicitely and the default information is described in a much poorer 
language than Default Logic. We rely on the general algorithm for computing 
rational closure (or some other algorithm that will be found suitable) to deal 
in a mechanical, uniform and tractable manner with the interactions between 
different pieces of default information. The fact that our language of assertions 
is much poorer than other formalisms seems to us to be a great asset. 

Nevertheless, it is probable that the size of useful conditional knowledge 
bases will be very large. Indeed, in our approach, adding new assertions to the 
knowledge base may solve almost any problem. Two main topics for further 
research may then be delineated. The first one is to find practical ways to avoid 
having to look at the whole knowledge base before answering any query. The 
set of assertions constituting a knowledge base will have to be structured (off- 
line, once and for all) in such a way that irrelevant assertions do not have to 
be looked at. The second one is to find lucid and compact descriptions of large 
conditional knowledge bases. This will involve looking seriously into the ques- 
tion: where does the conditional knowledge come from? Different answers may 
be appropriate in different domains: it may well be that conditional knowledge 
is derived from causal knowledge in ways that are different from those in which 
it is derived from conventions of speech or statistical information. 

6 Conclusion 

We have presented a mathematically tractable framework for nonmonotonic rea- 
soning that can be proved to possess many pragmatically attractive features. Its 
computational complexity compares favorably with that of most well-established 
systems. In many cases the intuitively correct answer is obtained. In others, 
the answer given and the way it was obtained provide an interesting point of 
view on the knowledge base. Much more practical experience is needed before 
one may assess the pragmatic value of the approach. The task of extending the 
results presented here to first-order languages is not an easy one. First steps 
towards this goal are described in [^o| . 
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A Lemmas needed to prove Theorem |5| 



Let us suppose that some rational consequence relation |~ is given. The notion 
of a consistent formula has been presented in Definition |^. Let S denote the set 
of all consistent formulas. Let us now recall Definition 10 of fl7|| . 

Definition 24 The world m eM is a normal world for a iff\/(3 e L such that 
a K 13, rn \= (3. 

The following is an easy corollary of Lemma 8 of [jl7| . 

Lemma 34 A formula is consistent iff there is a normal world for it. 

We shall now define a pre-order relation on the set S. 

Definition 25 Where a, f3 S S, we shall say that a is not more exceptional 
than (3 and write ctR.fi iff a V [3 \^ —<a. 



Lemma 35 The relation 1Z is transitive. 

Proof: Straightforward from Lemma [l7| The fact that the relation 1Z was 
restricted to the set 5* is not used here and 1Z would have been transitive also 
on the whole language C. | 

Lemma 36 Let a, f3 G S. Either alZfi or f¥R,a (or both). In particular 1Z is 
reflexive. 

Proof: The proof proceeds by contradiction. Suppose we have aljlfl and f37jLa. 
Then we have a V (3 K _, Q: and a V (3 K By And and Reflexivity we 
have a V [3 h -iaA^A(aV/3), and therefore a V [3 |~ false and, by Rule [l4|, 
(a V (3) A [3 K false. Therefore (3 f-° false, contradicting (3 S S. The fact that 
TZ was restricted to S is crucial here. | 

The following will be useful in the sequel. 
Lemma 37 If alZ(3, any normal world for a that satisfies [3 is normal for (3. 
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Proof: Suppose alZ/3, to is normal for a and satisfies 0. Let 7 be such 
that \y 7. We must show that m \= 7. Since m is normal for a and sat- 
isfies j3, it is enough to show that a |~ /3 — > 7. But, /3 |~ 7 implies, by Left 
Logical Equivalence, (a V /3) A K> 7. By the rule S of |l7fl , one then ob- 
tains aV |~ /3 — > 7. But, by definition of TZ, a V \f and, by Rational 
Monotonicity one deduces (a V (3) A a |~ [3 — > 7. | 

Definition 26 Lef a, ft £ S. We shall say that a is as exceptional as [3 and 
write a ^ iff aTZ0 and f31Za. 

Since TZ is reflexive and transitive, the relation ~ is an equivalence relation. The 
equivalence class of a formula a will be denoted by a and E will denote the set 
of equivalence classes of formulas of S under ~. We shall write a < (3 iff alZ0 
and we shall write a < (3 iff a < (3 and a ^ 0. This notation should cause no 
confusion with a similar notation used with a different meaning, in the context 



of preferential relations, in ||17| and in Section ^J. By Lemmas |35j and |36[ the 
relation < is a strict total order on the set E. 

Lemma 38 Let a, (3 be consistent formulas. If (3 <a then f3 |~ ^ol. 

Proof: The assumption implies that a 7jL(3, i.e., a V (3 |~ ->a. Rule ( p^ ) implies 
the conclusion. | 

Lemma 39 Let a, (3 be consistent formulas. If there is a normal world for a 
that satisfies (3, then (3 <a. 

Proof: If there is a normal world for a that satisfies (3, then we conclude by 
Lemma |3^ that a \/> -<f3. | 

Let W be the ranked model (V, Z, -<), where V C U x S is the set of all pairs 
< m, a > such that m is a normal world for a, l(< m, a >) is defined to be m 
and -< is defined as < m, a >^< n, (3 > iff a < (3. To show that W is a ranked 
model, we must prove that it satisfies the smoothness condition. 

Lemma 40 In W , the state < m, a > is minimal in (3 iff m |= f3 and [3 = a 

Proof: First notice that < to, a >G iff m \= [3. For the only if part, suppose 
that < m, a > is minimal in [3. The world to is normal for a and satisfies 0. By 



Lemma |39| we conclude that < a. But, since is consistent, by Lemma 34 
there is a normal world n for 0. The pair < n, > is an element of V that 
satisfies /3 and, by the minimality of < to, a > in /3, <n,0 >-/^< m,a >, i.e., 
-jta, i.e., a < 0. We conclude = a. For the «/ part, suppose that m is a 
normal world for a that satisfies /3 and that = a. If n is normal for 7 and 



< n, 7 >^< to, a > then 7 < a and therefore 7 < 0. By Lemma 38 7 |~ -<0 
and n, which is normal for 7, cannot satisfy 0. The state < to, a > is then 
minimal in 0. | 

The following is an immediate corollary of Lemma 
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Corollary 7 If m is a normal world for a the pair < to, a > is a state of V 
and is minimal in a. 

Proof: Suppose m is normal for a. First, since there is a normal world for a, 
a G S and the pair < to, a > is in V . Since to is normal for a it satisfies a. | 

We may now prove that the model W satisfies the smoothness property and 
defines the consequence relation \^ . 

Lemma 41 Let a be a consistent formula. The set a C V is smooth. 

Proof: Suppose < to, j3 >G a. Then, to is a normal world for (3 that satisfies a 
and, by Lemma [59], a < (3. If a = (3, then, by Lemma < to, [3 > is minimal 
in a. Otherwise, a < (3. In this case, let n be any world normal for a (there 
is such a world since a is consistent). The pair < n, a > is minimal in a by 
Lemma ^ and < n, a >« m, (3 >. 1 

Lemma 42 // < to, a > is minimal in (3, then m is normal for (3. 

Proof: Suppose < to, a > is minimal in (3. By Lemma Bol a = (3. Therefore 
alZ(3. But to is normal for a and satisfies f3, and Lemma |37| implies that to is 
normal for (3. | 



B Non-standard probabilistic semantics 
B.l Introduction 

We shall describe now, in Definition |33| another family of probabilistic mod- 
els, they provide much more direct semantics for nonmonotonic reasoning than 
Adams', at the price of using the language of non-standard (in the sense of 
A. Robinson) probability theory. The purpose of this section is to provide ad- 
ditional evidence in support of Thesis [y. We shall show that rational relations 
are exactly those that may be defined by non-standard probabilistic models. In 
other terms, if, given a probability distribution, we decide to accept the asser- 
tion a K f3 iff the conditional probability of (3 given a is very close to one, then 
the consequence relation we define is rational. On the other hand, any rational 
relation may be defined, in such a way, by some probability distribution. The 
results presented in the appendix are not used in the body of the paper. A dif- 
ferent representation theorem for rational relations, also based on Theorem ^|, 
in terms of one-parameter families of standard probabilistic models has been 
proved recently by K. Satoh p2| . Results relating the semantics of condition- 
als and non- Archimedean probabilities seem to have been obtained by R. Giles 
around 1980. 

There is a school of thought in Artificial Intelligence, represented in par- 
ticular by p, El, that denies the validity of the logical approach to modeling 
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common-sense reasoning. The alternative suggested is the Bayesian probabilis- 
tic approach. Namely, the only way in which we should make sensible inferences 
from our knowledge a is by estimating the conditional probability of the required 
conclusion given our knowledge a, and then adopting if we are satisfied that 
this conditional probability is close enough to 1. We believe that this approach 
may run into considerable practical difficulties, the choice being between keep- 
ing an explicit data base of these many conditional probabilities or estimating 
them from a small sample. The chief source of difficulty here is that knowing 
the probability of a and tells you very little about the probability of their 
intersection. 

But we shall not argue the matter in detail here. The main purpose of this 
section is to show that rational knowledge bases may be considered to come 
from such a probabilistic model, if we let the cut-off point of how close the 
conditional probability of given a has to be before we are ready to adopt 
as a sensible consequence of a, approach 1 as a limit. Namely, is a sensible 
consequence of a, iff the conditional probability is infinitesimally close to 1. In 
order to have an interesting theory, there must be probabilities that are not 
standard real numbers, but belong to a richer system of numbers, containing 
some infinitesimally small numbers. 

We shall show that this approach allows one to keep a probabilistic intuition 
while thinking about common-sense reasoning, namely think about a \^ as 
meaning that the conditional probability of given a is large, and still defines a 
well-behaved consequence relation that is not necessarily monotonic. Note that 
if one considers a standard probabilistic model and accepts a |~ as satisfied 
by the model iff the conditional probability Pr(a/0) > 1 — e, for some choice 
of a positive e one obtains a consequence relation that is not well-behaved. For 
instance, one may have a |~ and a |~ 7 satisfied by the model, while a |~ A 7 
is not satisfied. If, on the other one hand, one chooses e to be 0, one obtains a 
well-behaved consequence relation, but this relation is always monotonic, and 
the entailment defined is classical entailment (read |~ as material implication). 
J. McCarthy told us he suggested considering non-standard probabilistic models 
long ago, but, as far as we know, this suggestion has not been systematically 
pursued. 

The structure of this section is as follows: first we shall, briefly, survey the 
basic notions of non-standard analysis. We shall also introduce non-standard 
probability spaces. Then we shall introduce non-standard probabilistic models 
for non-monotonic reasoning, define the consequence relation given by such a 
model and prove that any consequence relation given by a non-standard proba- 
bility model is rational. Lastly we shall show that the axioms are complete for 
this interpretation, i.e., any rational consequence relation can be represented 
as the consequence relation given by some non-standard probability model, at 
least in the case the language C is countable. If £ is not countable, an easy 
counter-example shows the result does not hold, but we shall not elaborate in 
this paper. 
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B.2 Non-Standard Analysis 

Non-standard analysis was invented by Abraham Robinson in order to give a 
rigorous development of analysis in which limiting processes are replaced by 
behaviour at the infinitesimally small, e.g., the derivative becomes a quotient 
of the change in the function divided by the change in the argument, when the 
argument is infinitesimally increased. In this section we shall give a very brief 
introduction to the basic ideas. The reader interested in a full treatment can 
consult A. Robinson's j3l[] or Keisler's [jl6| books on the topic. More advanced 
topics related to non-standard probability theory are surveyed in j(| . 

The basic idea of non-standard analysis is to extend the real numbers to a 
larger ordered field while preserving many of the basic properties of the reals. 
Therefore, we consider a structure of the form 

TZ* = (R*,+*, x*,<*,0,l) 

such that TZ* is an elementary extension of the standard real numbers, namely 
R C R* , the operations and the order relation of TZ* extend those of R and for 
every first order formula $ 

TZ* \= $(a;i,...,ar„) iff R |= . . . ,x n ) 

for Xi,...,x n G R. Since we would like to consider not only properties of the 
real numbers, but real valued functions, functions from real valued functions 
into reals, and so on, we shall consider a richer structure: the superstructure of 
the real numbers. 

Definition 27 The superstructure of the set X is Voc(X) — U ra =o where V n 
are defined by induction: 

• V Q = X 

• V n -\-i = P(V n ) U V n where V(Y) is the power set of Y. 

Note that the superstructure of X contains all the relations on X, all n- valued 
functions from X into X, etc. In a non-standard model of the real numbers 
we would like to have a non-standard counterpart to any standard member of 
the superstructure of the real numbers. Note that the set theoretical relation 
G makes sense in the superstructure of X. Recall that a formula of the first 
order language having only G as a non logical constant is called bounded if is 
constructed by the usual connectives and bounded quantifiers, namely (Vx G y) 
and (3a; G y) meaning respectively: \/x if x G y then. . . and 3x x G y A . . .. 

Definition 28 A non-standard model of analysis is an ordered field TZ* that is a 
proper extension of the ordered field of the reals, together with a map * from the 
superstructure o/R into the superstructure oflZ*, such that for every bounded 
formula $>(xi . . . x n ): 

V^R) N *(oi • ■ ■ On) iff V^iTZ*) h $K ■ ■ ■ <) (Leibniz Principle) 
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and such that for x € R x* = x (we assume that * transforms the standard 
operations o/R into those of TV). 

The Leibniz principle guarantees that the non-standard counterpart of any stan- 
dard notion (namely its *) preserves many of the properties of the standard 
object. In particular it is an object of the same kind: for example if A is a set 
of functions from R to R, then A* is a set of functions from 1Z* into 1Z* . As 
another example consider the absolute value as a function from R to R. In R 
it has the property 

(Vz G R)(| x |> A (| x |= <-> x = 0)) 

Then by the Leibniz principle 

(Vz e 11*) (I x \*>* A (| x \*= «-► x = 0)) 

In fact since the * versions of the standard arithmetic operations and relations 
(like <, >,>,<) are so similar to the standard ones (they extend them) we shall 
simplify the notation by dropping the *, letting the context determine whether 
we mean the standard operation on R, or its extension to 1Z* . The next theorem 
shows that this is not a formal game: 

Theorem 8 (Robinson) There exists a non-standard model for analysis. 

The proof is an application of the compactness theorem. The extension of 
R, 1Z*, is not unique but nothing in the following arguments depends on the 
particular choice of the non-standard extension of R. So fix one such extension 
TV. 

Definition 29 1. x e 11*, x ^ 0, is called finite if | x < y for some y s R, 
or, equivalently, if \ x \< n for some natural number n. 

2. ieK* is called infinitesimal if for all e in R, e > 7 \ x \< e. Following 
our definition is infinitesimal. 

3. x e Voo{1Z*) is called internal if x € y* for some y s T4o(R)- The set of 
internal objects is denoted by V^. 

4- x <E Voo(1Z*) is standard if x = y* for some y E V^(R). 

It follows easily, from the fact that 1Z* is a proper extension of R, that there 
are infinitesimal, as well as infinite, members of 1Z* . In fact x is infinitesimal 
iff 1/x is infinite. If N is the set of natural numbers, one can show that N is 
a proper subset of N* and every member of N* — N is called a non-standard 
natural number. 

Lemma 43 1. The sum, product and difference of two infinitesimals is in- 
finitesimal. 
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2. The product of an infinitesimal and a finite member oflZ* is infinitesimal. 



Theorem 9 (Robinson's Overspill Principle) Let (A n | n G N) be a se- 
quence of members o/Vfc(R) for some k € N. Assume aZso i/iai, /or all n G N, 
4„ ^ and 4 n+ i C A n . Then HngN * s no ^ em Pty- 

Sketch of proof : Note that a sequence of elements of 14 (R) can be considered 
to be a function from N into 14 (R), and therefore it is a member of V^o(R). 
Hence (A n | n G N}* makes sense and it is a function from N* into T4(R)*. Its 
value at ft 6 N* will be denoted by {A)* h . Note that (A)* n = A* n for n G N. Let 
h G N* — N. One can easily check, using the Leibniz principle, that (4)£ is not 
empty and that for n G N (4)£ C 4* , hence n„ S N is not em Pty I 

We can now define the notion of non-standard probability space, which is 
like a standard (finitely additive) probability space, except that the values of 
the probability function are in 1Z*. 

Definition 30 An 1Z* -probability space is a triple (X,F,Pr) where X is a 
non-empty set , T is a Boolean subalgebra ofT > (X), (namely X G T, G T, 
and J- is closed under finite unions, intersections and differences) and Pr is a 
function from T into 1Z* such that 

1. Pr(A) > for A G T. 

2. Pr{X) = 1 

3. Pr(A UB)= Pr(A) + Pr(B) for A, B e J 7 , A and B disjoint 

Note that many of the notions that are usually associated with probability 
spaces are immediately generalized to 7£*-probability space, like independence 
of 'events' (namely sets in F) and conditional probability: if Pr(A) ^ then 
the conditional probability of B given A, is 

See H for sophisticated applications of non-standard probability spaces. A 
useful way of getting 7?*-probability spaces is by using hyperfinite sets, sets 
which are considered by 1Z* to be finite. 

Definition 31 An internal object A G is called hyperfinite iff there exists 
a function f G and h G N* such that f is a 1-1 mapping of h onto A. Note 
that we follow the usual set theoretical convention by which a natural number 
is identified with all smaller natural numbers. Of course here we apply this 
convention also to non-standard natural numbers. 
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By applying the Leibniz principle we can show that if A is hyperfinite and B 
is an internal subset of A, then B is hyperfinite. Given an 7?*-valued function 
f which is internal, and A an hyperfinite subset of the domain of f, we can 
naturally define the 'sum' of the values of f on A, YlxeAf( x )- XT i s defined 
by taking the * of the standard operation of taking the sum of a finite set of 
real numbers. J^* shares many of the properties of its standard counterpart, 
for example 

T,*xeAuBf( x ) = T,*xeAf( x ) + E* x eBf( x ) 

for A, B hyperfinite and disjoint. The next definition generalizes the notion of 
a finite probability space. 

Definition 32 (Hyperfinite Probability Space) Let A € be an hyper- 
finite set, let f be an internal 1Z* -valued function on A, which is not constantly 
zero and such that for x £ A f(x) > 0. Then the 7Z* -probability space gener- 
ated by A and f (denoted by PR* (A, f) ) is (A, T, Pr) where T is the collection 
of all internal subsets of A, and Pr is given by 

Pr{B) = 

One can verify that under the conditions of Definition |3^, PR* (A, f) is a 72.*- 
probability space. 

B.3 Non-standard Probabilistic Models and Their Conse- 
quence Relations 

An 1Z* probabilistic model is an 72.*-probability measure on some subset M. of 
U. Of course, we assume that for every formula of our language, a, the set a is 
measurable, namely it is in T . The probability measure induces a non-standard 
probability assignment to the formulas of the language by Pr(a) = Pr(a). The 
1Z* probabilistic model M. is said to be neat if for every formula, a, if Pria) = 
then a is satisfied in no world of M.. 

Definition 33 1. Let M be an 1Z* probabilistic model. The conditional 
assertion a f~ is valid in M, J\A \= a|~ [3, if either Pr(a) = or 
the conditional probability of [3 given a is infinitesimally close to 1, i.e., 
1 — Pr(f3 | a) is infinitesimal. Note that this is equivalent to saying that 
Pr(a) — or Pr(^(3 \ a) is infinitesimal. 

2. The consequence relation defined by A4 is: 
K(M) = {ah [3 | M h ah P} 

Theorem 10 (Soundness for Non-standard Probabilistic Models) For ev- 
ery 1Z* probabilistic model A4, K(AA) is a rational consequence relation. 
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Proof: Left Logical Equivalence, Right Weakening, and Reflexivity arc 

immediate. And follows from: 



Pr(->((3 A 7) I a) = Pr((-./3 V -.7) | a) < Pr{^0 | a) + Pr(^ 7 | a) 

and from the fact that the sum of two infinitesimals is infinitesimal. Or is 
proved by the following manipulation: 

r, / , ^ Prf-17 A (a V 3)) 

Pr -7 aV/3 = V 1 \ n} < 

Pr[a V p) 

Pr(-.7 A a) Pr (-17 A 3) 



Pr(a V /3) Pr(a V 3) 

Pr(-<j A a) Pr(-7 A 3) 

Pr(a) + Pr{8) 



< 



= Pr(^ 7 I a) + Pr(^ 7 | 3) 



and again using the fact that the sum of two infinitesimals is infinitesimal. We 
assumed above that Pr(a) > and Pr{3) > 0. If this fails then the argument is 
easier. We shall prove Rational Monotonicity by contradiction, so we assume 
that ah ->/? is not in K(Ai), and that ah 7 is in K(Ai). We shall prove that 
a A h 7 is in K(M). We can assume that Pr(a A 3) > (hence Pr(a) > 0) 
otherwise the argument is trivial. 



Pr(->7 I a A/3) 



Pr(-7 A a A /?) 
Pr(a A /3) 



Pr(-.7 A a A /3) Pr(a A /3) 

Pr(a) ' Pr(a) ~ 
Pr(-.7Aa) Pr(a A /?) 

Pr(a) ' Pr(a) _ 

^7 1 a) x ^i-^ (21) 

Since a h ~>P is not in K(M) , we get that Pr(3 \ a) is not infinitesimal, hence 

— ~tt — is finite. By Lemma f43 Pr(~n A a) x — i- — is infinitesimal. Hence 
Pr(3\a) J ' — Pr(p|a) 

by Equation ^l], a A /3 h 7 is in iiT(A^). Cautious Monotonicity now follows 
easily. Suppose a h 7 and a h 3 are both in isT(A^). If a h ~~>/3 is not in K(A4), 
we conclude by Rational Monotonicity. If a h is in i^(Al), we must have 
Pr(a) = 0, since Pr(8 | a) and Pr(-^3 \ a) cannot be both infinitesimally close 
to 1. Therefore Pr(a A 0) = and we conclude that a A 3 h 7 £ -R'(.M). | 



B.4 Completeness for the Non-Standard Probabilistic In- 
terpretation 

Theorem 11 Suppose the language C is countable (this assumption cannot be 
dispensed with) and P is a rational consequence relation on C Let TZ* be any 



54 



non-standard model of analysis, then there exists an 7Z-* -probabilistic neat model 
M such that K(M)=K. 

Proof: Let W = (S,l, -<), with ranking function r, be a countable (i.e., S is 
countable) ranked model that defines the consequence relation P. The model 
built in the proof of Theorem || shows that such models exist. If S is finite, or 
even if each level in W is finite and W is well-founded, one may simply use the 
construction described just before Lemma |2^, with some arbitrary infinitesimal 
e. In case the model W is infinitely broad, i.e., has some level containing an 
infinite number of states, then the construction has to be slightly more sophisti- 
cated, but the real difficulty appears when W is not well-founded, and we have 
already remarked that there are rational relations that have no well-founded 
ranked model. Following the proof of Lemma we would like to assign a 
(non-standard) probability distribution to the states of the model in such a way 
that the relative probabilty of a level to that of a lower level is infinitesimal, 
but, for every formula which is satified at a given level, we would like to keep 
its relative weight within the level non infinitesimal. To each formula we shall 
assign a positive real number r such that, if the formula is satisfied at level /, 
its relative probability within this level should be at least r. In order that these 
requirements not be contradictory, the sum of the r's so assigned should be at 
most 1. Quite arbitrarily, we pick for the i-th formula r = 1/2 I+1 . Now we have 
to show that we can find a probability assignment satisfying these requirements. 
We shall define a set B n of all probability assignments that are good up to rank 
n. An assignment which is good for every n will satisfy our requirements. So, 
we would like to intersect the B n 's. The overspill principle will tell us that this 
intersection is not empty. 

Since S is countable we may assume that S = N. Since every countable 
linear ordering may be order embedded into the real numbers, we may assume 
without loss of generality that the ranking function, r, is into R. Since -< is a 
partial ordering of N, -<* is a partial ordering of N* which is ranked by the 
ranking function r* mapping N* into 1Z* . 

For each formula a, let Aa — {&)*■ Note that Aa is a subset of N* (but 
must not be a subset of N). We can now associate a world, Uh, with each 
h G N*, defined by Uh \= P iff h G A p . It is easily checked that, for standard h 
(i.e., h G N), one has Uh = 1(h) and that, for arbitrary h, Uh (= a iff h G A a . 
Our idea now is to find an h in N* and an internal function /, from h into 1Z* 
such that, if we consider the probability distribution given by the hyperfinitc 
probability space PR*(h, f) on the set of worlds {Uk \ k € N*, k < h}, we shall 
get a probabilistic model whose consequence relation is exactly P (recall that 
we are identifying a member of N* with the set of smaller members of N*). 
Fix an enumeration (a n \ n G N) of all the formulas of our language. For i G N 
let Xi be the real number such that the ranking function / maps all the states 
minimal in on to it. 
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We are now going to define a sequence of sets of possible approximations to 
the object we are looking for, namely the appropriate h £ N* and the appropri- 
ate /. For ngN, let B n be the set of all triples of the form (k, e, /) that have 
the following properties: 

1. k > n, 

2. e e R, 6 > 0, e < 1/n, 

3. / is a function from N into R such that for any s £ N, f(s) > 0, 

4. for any x, y € R such that x < y, if x and y are in the range of the ranking 
function r on k, then 

Em<l!,r(m)=s f( m ) 
^2rn<k,r(m)=x f ( m ) 

5. for ai, i < k, if C = d, n {j r(j) = n {0, . . . , k - 1} ^ 0, then 

Em€C,m<t /( m ) 1 



Sm<fc,r(m)=a; i /( m ) 

It easily follows from the definition of the sequence of sets (B n \ n G N) that 
B n +i B n for n G N. One may also verify from item ^ that, if (fc, e, /) £ B n 
and if ir. is in the range of r on fc, then: 

Z)m<fc,r(m)>a: /( TO ) < ^ _ € 

Sm<fc : r(m)=a; /( TO ) i=1 l~ e 



Lemma 44 For any neN, S„ ^ 0. 

Proof: The proof is essentially similar to the remarks preceding the proof of 



Lemma [22| in Section [F3|. Let, indeed, W n be the finite ranked model defined by 
({0, . . . ,n — 1}, /). We can easily arrange a probability assignment for it such 
that the ratio of the probability of each rank and and each smaller rank will 
be at most 1/n. Within the rank we have to satisfy item |^ in the definition of 
B n but we can easily arrange for i < n, that if has a non empty intersection 
with this rank, then its relative probability within this rank is at least t^tt- 
This may be arranged because X^ieN = ^ we ex te n d this probability 
assignment to any function from N into R, we see that (n, -,/) £ B n . | 

Once we have Lemma ^ we can use Robinson's overspill principle (Theorem 
||) to show that n„ e N-Bn IS n °t empty. So let (h,e,f) be a member of B* t for 
every n £ N. One can easily verify that h is in N* and that it is a non-standard 
natural number: indeed for every n £ N, h > n since (h, i, /) £ -B* . Similarly e 
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is a positive member of 1Z* such that for every standard natural number n we 
have e < — , hence e is a positive infinitesimal. Also / is a function from N* 
into the positive members of 1Z*, satisfying the appropriate transfer of items ^| 
and ^ into the context of 1Z*. In particular, Equation carries over and we 
have x = r*(m) for some m 6 N*, m < h: 

E* I f(m) 

m<fl,r* (m)>x ^ £ 

E* r ~ . /M " i- 

m</l,r* (m)— a; 

We conclude therefore that the left-hand side of Equation |23| is infinitesimal. 
We claim that the 7Z* probabilistic model M. whose collection of states is h, i.e., 
{m | m s N*,m < /i}, the world associated with m is W m , and the probability 
measure is given by the hyperhnite probability space PR*(h, /) is the model we 
are looking for. Since any / satisfying the requirements can be multiplied by 
any positive member of TZ* and still satisfies the requirements, we may assume 
without loss of generality that 

Note that M is a neat model since, if we have both m < h and lA m h a, we 
must also have Pr(a) > f(m) > 0. 

Claim 1 K(M) = K 

Proof: First note that ah false e K{M) iff ah false e K . If ah false e K, 
then Aq, = 0, hence {m \ m e N*,W |= a} = 0. Therefore ah false G if(.M). 
For the other direction, if a h false ^ iC, then, for some m £ N, f/ TO |= a. But 
m, being a standard natural number, is less than h, hence some state in M. 
satisfies a. By the neatness of Ai, ah false ^ K{M). By the previous remark, 
we can now assume that a h false ^ K, hence a / 8. Let m € N be minimal 
in a and let x — r(m). Let i € N be such that a = a^_i. In particular we have: 

(Vy € R)(y < a; =>■ r _1 (y) n a) = 0. 
Using the Leibniz principle we get: 

{m | m £ N* , m < h,U m (= a} C {m | m £ N*,r*(m) > a;}. 
Let us define now 

? 7 = E* ~ h „, w 

and 
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(23) 



For every formula 7 define: 

A( 7 )=V* - /(m) 

Of course one always has Pr(j) > A (7). Note that by Equation rj/p is 
infinitesimal. Also by item || of the definition of the sequence (B n | n € N) if 
Aj n {m I m <E h,r*(m) = x} ^ and if 7 = ay_i, j £ N then 

A( 7 ) > P x 

Now, assume ah /? 6 if. Hence for every m S h, if hi |= A a, we must have 
r*(m) > x. Therefore Pr(^/3 A a) < 77. Therefore: 

Pr(a) i p 

Therefore Pr(-ij3 \ a) is infinitesimal and by definition a |~ (3 € if (.M). If a K /3 if , 
then some m £ N, r* (m) = 2; satisfies W m |= — 1/9 A a. But this m satisfies m G /i, 
so it is in our model. Let j € N be such that -ij3 A q = Oj_i. Since we clearly 
have: Pr(a) < p + r], we also have: 



Pr(a) ~ p + T] ~ 2J+ 1 

since obviously p> rj. So Pr(^f3 \ a) is no£ infinitesimal and (3 ^ K(A4). 
(end of proof of Claim 0) | 

We have already noticed that M. is a neat model. Claim [j] shows that it has 
the desired property, (end of proof of Theorem | 
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